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1.  INTRODUCTION  AND  SUMMARY 


This  technical  report  describes  research  performed  on  the  distributed  pro¬ 
cessing  of  sensor  data  for  situation  assessment  in  a  distributed  sensor  network 
(DSN).  Thn  research  was  performed  at  Advanced  Decision  Systems  under  the 
contract  entitled  “Distributed  Hypothesis  Testing  in  Distributed  Sensor  Net¬ 
works”  . 

1.1  DSN  PROBLEM  DESCRIPTION 

We  assume  a  system  structure  as  in  Figure  1-1.  There  is  a  system  of  distri¬ 
buted  sensor/processor  nodes.  Each  node  may  have  one  or  more  sensor  types, 
and  the  sensors  from  different  nodes  may  have  overlapping  coverage.  The  sensors 
collect  data  from  the  environment  and  pass  them  on  to  the  processors  (processing 
nodes).  The  processing  nodes  process  the  sensor  data  and  communicate  with 
other  nodes  through  the  communication  network  to  obtain  an  assessment  of  the 
state  of  the  world.  It  is  generally  assumed  that  no  single  node  possesses  complete 
information  and  each  node  may  have  a  different  world  model.  The  processing 
nodes  may  also  control  the  sensors  to  improve  on  the  performance  of  the  overall 
system. 

A  distributed  sensor  network  can  be  used  for  many  applications.  We  are 
particularly  interested  in  a  DSN  which  is  used  for  the  tracking  and  classification 
of  multiple  targets!  The  target  environment  is  assumed  to  be  dense,  so  that 
determining  the  origins  of  the  measurements  in  a  particular  sensor  report  is  not 
always  easy.  The  problem  is  further  complicated  by  the  presence  of  false  alarms 
and  missing  target  reports.  In  such  a  network,  tracking  and  classification  is 
highly  dependent  on  identifying  the  right  data  association  hypotheses.  Since  the 
nodes  in  general  have  access  to  different  information,  communication  among  the 
nodes  can  greatly  improve  the  performance  of  the  system.  The  problem  is  thus 
one  of  distributed  hypothesis  formation  and  evaluation,  which  we  can  abbreviate 
as  distributed  hypothesis  testing. 

In  our  previous  DSN  project  we  initiated  research  on  the  distributed  track¬ 
ing  of  multiple  targets  by  the  nodes  of  a  distributed  sensor  network.  In  the  fol¬ 
lowing  we  shall  review  a  model  of  the  processing  node  that  has  been  studied. 


COMMUNICATION  NETWORK 


*  SENSOR 
-  PROCESSOR 


Figure  1-1:  Distributed  Sensor  Network 


1.2  PROCESSING  NOD  IODEL 


The  processing  nodes  are  ttie  main  information  processing  units  in  the  DSN. 
Each  processing  node  collects  measurements  from  a  set  of  sensors.  Its  functions 
are  to  process  the  local  sensor  data  to  form  an  assessment  of  the  state  of  the 
world,  to  combine  the  information  obtained  from  other  nodes  with  the  local  infor¬ 
mation  to  update  its  assessment,  to  distribute  information  to  other  nodes,  and  to 
performs  these  functions  effectively.  These  functions  are  performed  in  four 
separate  modules  within  each  processing  node  (see  Figure  1-2).  In  the  following 
we  shall  discuss  the  modules  in  more  detail. 

1.2.1  Generalized  Tracker/Classifier 

This  module  is  responsible  for  the  local  data  processing  before  any  com¬ 
munication  with  the  other  nodes  takes  place.  Since  the  objective  of  the  system 
under  consideration  is  the  tracking  and  classification  of  multiple  targets,  this 
module  is  a  multitarget  tracker.  In  the  previous  project,  we  developed  a  general 
theory  for  multitarget  tracking  which  is  implemented  in  the  form  of  the  General¬ 
ized  Tracker  I  Classifier  (GTC).  The  GTC  has  the  structure  shown  in  Figure  1-3 
and  itself  consists  of  four  modules.  The  hypothesis  formation  module  forms  mul¬ 
tiple  hypotheses  from  the  sensor  data,  each  consisting  of  a  collection  of  tracks  to 
explain  the  origins  of  the  measurements  in  each  data  set.  These  hypotheses  are 
then  evaluated  by  the  hypothesis  evaluation  module  with  respect  to  their  proba¬ 
bilities  of  being  true.  The  filtering  and  parameter  estimation  module  generates 
state  estimates  and  classifications  for  each  track.  It  is  essential  for  hypothesis 
evaluation  and  can  thus  be  viewed  as  a  submodule.  To  stay  within  the  computa¬ 
tional  constraints  of  each  node,  the  hypotheses  are  pruned,  combined,  clustered, 
etc.  This  takes  place  in  the  hypothesis  management  module.  The  result  of  this 
processing  is  a  set  of  hypotheses  and  their  probabilities,  a  collection  of  tracks 
corresponding  to  possible  targets  and  the  state  distributions  of  these  tracks. 
These  quantities  together  constitute  the  information  state  for  multitarget  track¬ 
ing. 

1.2.2  Information  Fusion 

This  module  combines  the  local  information  with  information  obtained  from 
the  other  nodes  to  obtain  a  new  situation  assessment.  The  information  from  the 
local  nodes  consists  of  the  information  described  above.  The  information  from 
other  nodes  is  also  similar.  Information  fusion  then  consists  of  the  following  steps 
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Figure  1-3:  Generalized  Tracker/Classifier 
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1.  Hypothesis  Formation  -  Giveri  a  set  ot  hypotheses  from  other  nodes,  this 
submodule  generates  new  global  hypotheses.  Tracks  from  the 
hypotheses  of  different  nodes  are  associated  in  all  possible  ways,  whether 
they  correspond  to  the  same  or  different  targets. 

2.  Hypothesis  Evalu  '  -  Each  of  .he  hypotheses  formed  above  is  then 
evaluated  with  respect  to  its  probability  of  being  true.  The  statistics  of 
the  tracks  from  different  hypotheses  are  used  in  this  evaluation.  For 
example,  if  two  tracks  are  widely  apart  in  their  position  or  velocity  dis¬ 
tributions,  they  are  more  likely  to  have  come  from  different  targets  than 
the  same  target. 

3.  Hypothesis  Management  -  This  is  again  needed  to  make  computation 
feasible  within  the  available  resources. 


1.2.3  Information  Distribution 

This  module  decides  what  information  is  to  be  transmitted,  who  gets  the 
information,  and  when  it  should  be  communicated.  It  thus  specifies  t.ie  imorma* 
tion  available  to  each  node  at  any  time,  i.e . ,  the  information  structure  of  the  sys¬ 
tem.  Information  distribution  can  be  fixed  a  priori  for  simple  systems,  or  it  can 
be  higlly  adaptive  to  the  information  needs  in  the  system. 


1.2.4  Resource  allocation 

This  module  allocates  the  resources  under  the  control  of  the  processing  node 
to  maintain  or  improve  the  performance  of  the  system.  Some  typical  resources 
include  sensor  resources  and  processing  resources.  Both  resource  allocation  and 
information  distribution  can  affect  the  information  available  in  the  network. 
Thus  their  activities  should  be  coordinated. 


Hypotheses.  Tracks 
Hypothesis  Probabilities 


Figure  1-4:  Information  Fusion 
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Many  technical  issues  have  to  be  addressed  before  DSNs  can  be  designed, 
built  and  operated  to  achieve  their  military  potential.  Such  issues  include  the 
representation  and  processing  of  hypotheses,  information  fusion,  communication 
strategies,  resource  allocation,  adaptation,  system  architecture,  etc.  In  our  previ¬ 
ous  DSN  project,  we  successfully  addressed  some  of  these  issues.  The  goal  of  our 
current  effort  was  to  further  advance  the  state  of  the  art  in  distributed 
hypothesis  testing  techniques  in  DSNs.  This  would  provide  more  insight  as  to 
how  a  DSN  should  be  designed.  Specifically,  we  intended  to  accomplish  the  fol¬ 
lowing  technology  goals: 


1.  Develop  intelligent  distributed  algorithms  applicable  to  a  wide  range  of 
situations  such  as  different  network  configurations,  sensor  types,  target 
models;  such  algorithms  should  also  be  adaptive  to  changing  network 
conditions  and  make  efficient  use  of  sensor  resources. 


2.  Evaluate  and  adapt  these  algorithms  for  real-time  implementation. 


J|  3.  Design  experiments  to  test  and  evaluate  the  algorithms  in  a  more  realis- 

k*‘  tic  scenario  such  as  that  used  by  the  Lincoln  Laboratory  test-bed. 

>:• 

< 

Along  with  these  technology  goals,  our  plan  was  to  develop  a  simulation  environ- 
S’  ment  to  test  the  algorithms  experimentally  on  different  scenarios. 


1.4  PROJECT  ACCOMPLISHMENTS 
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There  were  two  parts  to  our  research  effort.  The  first  consisted  of  develop¬ 
ment  of  algorithms  for  a  DSN  and  the  other  was  concerned  with  the  development 
of  a  simulation  environment  to  test  the  algorithms  and  to  evaluate  the  perfor¬ 
mance  of  the  system  experimentally.  In  the  following  we  discuss  both  the 
theoretical  and  experimental  results. 

We  extended  the  results  of  our  previous  DSN  project  and 
developed  information  infusion  algorithms  for  DSNs  with  arbitrary 
communication  patterns  among  the  nodes.  The  key  problems  are  the  for¬ 
mation  of  possible  (or  meaningful)  global  hypotheses  from  a  group  of  local 
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hypotheses  and  the  evaluation  of  their  probabilities.  A  set  of  local  hypotheses 
can  be  inconsistent  so  that  they  cannot  be  fused  to  form  a  global  hypothesis. 
The  local  probabilities  of  the  local  hypotheses  may  depend  on  common  informa¬ 
tion  which  needs  to  be  identified.  In  the  previous  project,  we  developed  fusion 
algorithms  assuming  broadcast  communication.  In  the  current  project,  we 
obtained  fusion  algorithms  for  arbitrary  communication.  The  algorithms  are 
based  on  modeling  the  events  in  the  DSN  by  means  of  an  information  graph.  To 
use  these  algorithms,  the  histories  of  the  hypotheses  and  tracks  have  to  be  part  of 
the  information  communicated.  Then  each  node  can  determine  the  fusability  of 
the  hypotheses  and  tracks  and  the  common  information  which  has  to  be  removed 
in  evaluating  the  hypotheses.  Information  distribution  strategies  were  also  con¬ 
sidered.  These  include  strategies  which  depend  only  on  the  local  information 
state  and  those  which  model  the  behavior  of  other  nodes. 

The  theory  of  multitarget  tracking  was  extended  to  handle  targets 
with  a  structured  state  space  and  dissimilar  sensors  which  observe 
different  components  in  the  target  state.  The  resulting  GTC  for  processing 
of  local  sensor  data  and  the  information  fusion  algorithms  are  very  similar  to  the 
usual  case.  However,  a  multilevel  hypothesis  formation  and  evaluation  processing 
architecture  is  often  possible.  Consider  a  network  with  two  nodes.  Each  node 
would  form  hypotheses  based  on  the  local  measurements  and  the  tracks  would  be 
described  in  the  local  feature  space.  During  the  fusion  process,  knowledge  on  the 
relationship  between  the  features  would  be  used  to  generate  higher  level  target 
tracks  from  the  local  feature  level  tracks.  Hypothesis  evaluation  would  then  be 
carried  out.  As  an  example,  consider  the  tracking  of  vehicles.  Suppose  one  sen¬ 
sor  node  measures  only  the  tread/wheel  feature  and  the  location.  Feature  tracks 
from  this  node  would  consist  of  wheeled  or  tread  vehicles  over  time.  Suppose 
another  sensor  node  measures  only  the  location  and  whether  the  vehicle  has  gun 
or  no  gun.  Tracks  generated  would  consist  of  gunned  or  gunless  vehicles  over 
time.  During  fusion,  one  would  use  the  fact  that  a  vehicle  with  a  gun  and  tread 
is  a  tank,  a  vehicle  with  neither  gun  nor  tread  is  a  truck,  etc. 

In  the  previous  DSN  project,  we  concentrated  on  independent  targets.  In 
this  project,  we  investigated  multitarget  tracking  on  structured  sets  of 
targets.  These  include  targets  which  move  in  groups.  One  example  would  be 
planes  flying  in  formation.  Another  more  complex  example  consists  of  military 
force  structures.  A  division  would  consist  of  regiments  each  of  which  consists  of 
battalions,  and  so  on.  The  tracking  and  identification  of  such  structured  targets 
is  important  but  not  much  systematic  treatment  is  available.  The  problem  is 


also  interesting  in  a  distributed  framework  since  the  observations  at  different 
nodes  may  be  at  different  levels  and  targets  are  no  longer  independent.  We 
developed  models  for  structured  sets  of  targets,  and  the  notions  of  multilevel 
tracks  and  hypotheses.  They  are  generalization'  of  our  previous  work  on  multi- 
target  tracking  which  may  be  viewed  as  having  a  single  level  of  targets.  Central¬ 
ized  algorithms  for  evaluating  multilevel  hypotheses  were  obtained.  When  res¬ 
tricted  to  two  levels  with  targets  moving  in  independent  and  identically  distri¬ 
buted  groups,  our  results  resemble  those  in  single  level  tracking  except  the  tar¬ 
gets  in  the  level  are  the  groups  themselves.  The  main  difficulty  in  implementing 
these  algorithms  is  in  the  combinatorics,  which  becomes  more  severe  with  more 
levels.  Th  more  practical  methods  for  hypothesis  evaluation  have  to  be  found. 
These  results  can  serve  as  a  starting  point  for  finding  distributed  versions  of  the 
algorithms. 

As  part  of  the  DARPA  DSN  program,  M.I.T.  Lincoln  Lab.  has  performed 
research  on  the  tracking  of  low  flying  aircraft  using  acoustic  sensors.  A  DSN 
test  bed  has  been  developed  and  used  to  test  and  demonstrate  DSN 
techniques  and  technology.  The  emphasis  of  the  research  at  Lincoln  his  been 
to  demonstrate  that  a  DSN  is  feasible  via  the  construction  of  a  complete 
(hardware  and  software)  system.  Our  emphasis,  on  the  other  hand,  has  been  the 
development  of  general  algorithms  to  detect  and  track  targets  in  difficult 
scenarios  involving  high  target  density,  high  false  alarm  rates,  and  poor  detection 
conditions.  To  illustrate  the  applicability  of  this  general  multiple  hypothesis  to 
acoustic  tracking,  we  considered  to  design  of  experiments  using  the  Lincoln  Lab. 
acoustic  tracking  scenario.  Possible  system  architectures,  and  simulation 
scenarios  were  investigated  with  inputs  from  Lincoln  Lab.  In  addition,  we 
adapted  the  general  distributed  tracking  algorithm  to  acoustic  tracking.  Because 
of  the  special  features  of  acoustic  sensors  (such  as  azimuth  only  measurements, 
acoustic  propagation  delay),  some  modifications  were  made  to  the  general  algo¬ 
rithm. 

The  other  part  of  our  research  effort  was  concerned  with  the  development 
of  the  simulation  environment.  Since  an  analytic  evaluation  of  the  algorithms 
and  the  system  performance  is  difficult  our  approach  is  to  perfom  simulation 
studies.  We  developed  a  simulation  system  consisting  of  four  DSN  nodes 
with  communication  patterns  which  can  be  specified  arbitrarily.  Our 
eventual  goal  for  the  simulation  environment  is  that  it  should  allow  rapid  con¬ 
struction  of  scenarios  and  rapid  development  of  the  DSN  system  design  itself. 
Also,  the  environment  should  be  flexible  enough  to  handle  various  types  of 


2.  INFORMATION  FUSION  FOR  ARBITRARY  COMMUNICATION 


In  this  section  we  present  algorithms  used  by  each  node  to  fuse  the  infor¬ 
mation  received  from  the  other  nodes  with  the  local  information  to  obtain  an 
updated  situation  assessment.  In  l1  fusion  algorithms  for  a  broadcast  communi¬ 
cation  pattern  were  presented.  The  results  of  this  section  extend  those  algo¬ 
rithms  to  arbitrary  communication  patterns.  In  Section  2.1  we  describe  the  infor¬ 
mation  fusion  problem  in  the  context  of  hypothesis  formation  and  evaluation  in 
multitarget  tracking.  In  Section  2.2  a  model  for  information  fusion  in  terms  of 
an  information  graph  is  given.  Section  2.3  describes  the  hypothesis  formation 
and  evaluation  algorithms  assuming  arbitrary  communication. 

2.1  THE  INFORMATION  FUSION  PROBLEM 

In  the  following  we  state  the  information  fusion  problem  faced  by  each 
node  in  the  DSN  with  emphasis  on  the  relevant  issues  in  multitarget  tracking. 
The  formalism  is  based  on  the  theory  of  multitarget  tracking  developed  in  the 
previous  DSN  project  [l],  [2],  and  [3], 

2.1.1  Local  processing 

The  basic  unit  of  information  in  the  DSN  is  a  sensor  report  z(t  ,s).  This  is 
the  output  of  a  sensor  s  at  a  time  t  and  is  denoted  as 

((t/j  ( t  ,s  )),N~i  '*  \nm  (t  ,s  ),t  ,s  ).  The  index  k  =(<  ,s  )  identifies  the  sensor  report  (by 
time  and  sensor)  uniquely  and  is  called  the  sensor  report  index  or  data  index. 

Nm(k)  is  the  number  of  measurements  in  the  report  and  (y,  (k))^^  *  is  the 
actual  measurement  vector.  At  any  given  time,  let  Z  be  the  data  set  consisting 
of  a  set  of  sensor  reports  and  K  be  the  associated  data  index  set,  i.e,  the  set  of 
the  indices  for  all  the  sensor  reports  contained  in  Z .  The  measurement  index  set 
corresponding  to  Z  is  defined  as 

J  =  U  {1 . /VM(*)}X{i}.  (2.1) 

*  eK 

Each  element  (j  ,k  )=(j  ,t  ,s  )  in  this  set  represents  the  j-th  measurement  gen¬ 
erated  at  time  t  by  sensor  s.  The  specific  value  of  the  measurement  is  y;  (<,s). 
According  to  the  system  model  introduced  in  Section  1,  each  node  processes  the 
sensor  data  as  they  arrive  using  the  Generalized  Tracker/  Classifier  (GTC).  The 


2-1 


■V'-.  Vs  V vv 


output  of  the  GTC  when,  the  data  is  Z  consists  of  the  information  state  E(Z) 
defined  as 

E(Z).=  (T  (/■),(*(*  |  r,Z))reT(J),  H  (/),  (P  ( A=X  |  Z))xeH(y),  *W) 

where 

•  T(y),  the  set  of  possible  tracks  defined  on  J .  Each  track  r  is  a  subset  of 
J ,  i.e.,  tCJ  and  represents  the  measurement  indices  coming  from  a  single 
target.  It  is  usually  assumed  that  a  track  cannot  have  two  measurement 
indices  in  the  same  sensor  report,  or  the  sensor  resolution  is  such  that 
there  are  no  split  measurements.  Such  tracks  are  then  said  to  be  possi¬ 
ble. 

•  pt{x  |  t,Z  )  is  the  state  distribution  for  a  track.  Given  the  track  r,  the  set 
of  measurements  in  Z  for  a  hypothesized  target  is  known.  From  this  the 
distribution  of  its  state  x  (position,  velocity,  classification,  etc.)  at  a  time 
t  can  be  found  and  is  a  traditional  estimation  problem.  Normally  this 
would  be  given  in  terms  of  a  probability  distribution;  but  if  the  state  can 
be  approximated  by  a  Gaussian  random  vector,  the  distribution  can  be 
expressed  in  terms  of  its  mean  and  covariance. 

•  H(7)  is  the  set  of  possible  data-to-data  association  hypotheses  defined  on 
J .  Each  data-to-data  association  hypothesis  X  is  a  possible  explanation 
about  the  origins  of  all  the  measurements  in  Z .  Each  hypothesis  consists 
of  a  set  of  tracks,  i.e.,  X  =  {rx,7-2,....}.  The  number  of  tracks  in  X  is  the 
number  of  targets  hypothesized  to  have  been  detected  in  the  data  set  Z . 
Each  track  r  is  the  set  of  measurement  indices  from  a  hypothesized  target 
and  any  measurement  index  not  included  in  the  hypothesis  is 
hypothesized  to  be  a  false  alarm.  We  assume  that  the  sensor  resolution  is 
such  that  there  are  no  merged  measurements  and  thus  there  are  no  over¬ 
lapping  tracks  in  the  same  hypothesis.  The  set  of  hypotheses  satisfying 
this  property  is  said  to  be  possible.  This  represents  all  mutually  exclusive 
and  collectively  exhaustive  explanations  about  the  origins  of  the  measure¬ 
ments  in  Z . 

•  P  (A=X  |  Z )  is  the  probability  of  that  the  true  data  association  A  is  a 
hypothesis  X  given  all  the  measurements  in  Z.  Its  computation  is  the 
key  operation  in  any  multiple  hypothesis  approach  to  multitarget 
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tracking  and  recursive  algorithms  were  given  in  [l],  [2],  and  [3]. 

•  i/(if).is  the  expected  number  of  undetected  targets  up  to  and  including 
AT.  It  is  important  for  initiating  new  tracks.  If  v(K )  decreases,  the  likeli¬ 
hood  of  any  measurement  coming  from  a  previously  undetected  target 
also  decreases. 


The  information  state  defined  above  constitutes  a  state  for  multitarget 
tracking  since  it  contains  all  the  relevant  information  present  in  the  cumulative 
data  set  Z .  As  long  as  the  information  state  E(Z)  is  known,  the  GTC  can  con¬ 
tinue  to  process  any  new  sensor  report  even  though  the  actual  data  Z  is  no 
longer  available.  When  a  report  is  received  from  a  local  sensor,  the  local  tracking 
data  ire  updated.  There  are  three  submodules  corresponding  to  the  functions  of 
hypothesis  formation,  hypothesis  evaluation,  and  hypothesis  management. 

The  hypothesis  formation  submodule  forms  new  hypotheses  from  the  old 
hypotheses  and  the  data.  Consider  a  report  *(t,s)  from  sensor  s  at  time  t. 
Each  measurement  y;  (t  ,s )  in  the  report  may  come  from  a  previously  detected 
target,  from  a  new  target  or  a  false  alarm.  At  the  same  time,  a  previously 
detected  target  may  be  missed  (undetected)  in  the  current  sensor  report. 
Hypothesis  formation  thus  consists  of  generating  these  possibilities  starting  from 
the  old  hypotheses.  Constraints  imposed  by  the  measurement  values  and  possible 
predicted  states  of  the  old  tracks  should  be  used  to  reduce  the  number  of 
hypotheses  formed  whenever  possible.  As  a  result  of  this  step,  sets  of  possible 
tracks  T(/)  and  possible  hypotheses  H(7)  are  formed. 

The  hypothesis  evaluation  module  is  responsible  for  computing  the  state  dis¬ 
tribution  pt(x  |  r,Z),  the  probability  of  each  hypothesis  P(\—\\Z)  and  the 
expected  number  of  undetected  targets  v{K ).  Recursive  algorithms  have  been 
developed  for  computing  these.  Suppose  k  =  (<,s)  represents  a  new  sensor 
report  and  the  quantities  just  before  the  arrival  of  this  sensor  report  are  denoted 
by  Z ,  K  and  J  respectively.  Then 

P  (A=X  |  Z)  =  C-lP(X^X  |  Z)LFA(k,\)  IlL  {y  (k  ,r),r)  (2.2) 

r£X 

where  C  is  a  normalization  constant,  y(k,r )  is  the  measurement  in  the  sensor 
report  z  ( k  )  associated  with  track  r.  The  right-hand  side  of  the  equation  depends 
on  the  following  likelihoods: 
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•  Likelihood  of  false  alarms  LFA  (k  ,\) 

•  Likelihood  of  a  previously  detected  track  7  detected  again  as  measurement  y 

L  (y  (k  ,r),r)  =  J*  pm{  y  \x)pD(x)pt  ( x  \t,Z)  p(dx)  (2.3) 

•  Likelihood  of  a  previously  detected  track  7  missed  in  the  current  report 

L(y(k  ,r),7)  =  f  (1  -pD  (x  ))  pt  (x  |  J,Z  )  n[dx)  (2.4) 

•  Likelihood  of  a  target  newly  detected  as  y 

L{y{k  ,r),7)  =  V  f  pm  (y  |  x)  pD(x)  p,(x  \  t,Z)  p{dx  )  (2.5) 

In  the  above  the  target  state  x  is  a  hybrid  variable  with  a  continuous  part  to 
model  geolocation  variables  and  a  discrete  part  to  model  classification  informa¬ 
tion.  For  convenience,  we  define  a  hybrid  measure  pi  on  the  state  space  to  be  the 
direct  product  of  a  continuous  measure  and  a  discrete  measure.  Then  any 
integral  with  respect  to  this  hybrid  measure  is  a  sum  of  integrals  over  the  con¬ 
tinuous  part  of  the  state  space.  These  likelihoods  can  be  computed  at  the  same 
time  as  updating  the  state  estimates  of  the  tracks.  When  the  target  and  sensor 
models  are  such  that  the  linear  and  Gaussian  assumptions  are  satisfied,  most  of 
the  quantities  involved  are  available  from  the  Kalman  filter  calculations.  As  a 
result  of  these  calculations,  probabilities  of  hypotheses  and  track  state  distribu¬ 
tions  can  be  obtained. 

The  hypothesis  management  submodule  controls  the  growth  in  the  number 
of  hypotheses  to  make  the  algorithm  implementable.  This  step  is  crucial  for  the 
successful  of  the  multiple-hypothesis  approach.  Hypothesis  management  tech¬ 
niques  include  pruning  away  low-probability  hypotheses,  combining  similar 
hypotheses  and  decomposing  the  hypothesis  set  into  independent  clusters. 


2.1.2  Information  Fusion  Problem 


We  assume  that  each  node  communicates  the  information  state  to  the  other 
nodes.  Suppose  a  node  receives  some  messages  from  the  other  nodes.  It  has  to 
fuse  or  integrate  this  information  with  the  local  information  to  improve  on  the 
local  estimate.  There  are  many  ways  of  performing  fusion.  In  our  work  fusion  is 
based  on  the  following  philosophy.  The  ideal  case  with  the  highest  performance 
(but  also  the  highest  communication  cost)  is  when  the  nodes  communicate  the 
actual  sensor  data  through  the  network  instead  of  the  processed  information.  In 
this  case  a  node  would  be  able  to  generate  an  optimal  information  state  based  on 
all  the  data  available.  Since  n.  a  more  realistic  DSN  only  the  information  states 
are  communicated,  an  appropriate  objective  for  fusion  is  to  reconstruct  the 
optimal  information  state  based  on  the  information  states  received  from  the  other 
nodes.  To  facilitate  further  discussion,  we  call  the  data  available  to  each  node 
before  communication  takes  place  as  local  data  and  the  maximum  data  set  avail¬ 
able  after  communication  as  global  data.  Local  and  global  information  states, 
hypotheses,  tracks,  etc.  are  all  defined  analogously. 

There  are  thus  two  steps  to  the  fusion  process.  The  first  step  in  the  fusion 
process  consists  of  generating  the  possible  track  and  hypothesis  sets  based  on  the 
global  data  from  the  local  tracks  and  hypotheses.  Since  the  local  data  are  the 
part  of  the  global  data  available  to  the  nodes  at  the  given  times,  the  global 
tracks  and  hypotheses  when  restricted  to  the  local  data  should  give  the  local 
tracks  and  hypotheses.  This  implies  that  a  certain  combination  of  local  tracks 
and  hypotheses  should  not  be  fused,  i.e.,  there  may  not  exist  global  tracks  and 
hypotheses  for  given  sets  of  local  tracks  and  hypotheses.  In  Figure  2-1,  the  two 
tracks  rj  and  r2  are  two  local  tracks  maintained  at  two  different  nodes.  They 
cannot  be  fused  since  the  resulting  global  track  would  have  two  different  meas¬ 
urements  in  the  same  sensor  report  1,  thus  violating  the  no  split  measurement 
assumption.  On  the  other  hand,  r,  and  r3  can  be  fused  to  yield  a  global  track 
rl\Jr2-  The  interpretation  of  this  global  track  is  that  the  measurements  in  both 
tracks  tv  and  r3  come  from  the  same  target.  Tracks  ^  and  r4  can  also  be  fused. 
However,  they  do  not  have  to  be  and  in  that  case  the  two  tracks  correspond  to 
two  different  targets.  The  fusability  question  also  needs  to  be  addressed  at  the 
hypothesis  level.  Each  local  hypothesis  is  a  possible  explanation  about  the  origins 
of  the  local  measurements.  Thus  if  the  local  hypotheses  are  incompatible,  they 
cannot  be  fused  to  form  a  global  hypothesis.  This  is  illustrated  in  Figure  2-2 
where  each  node  i  has  two  local  hypotheses  X/,  j  =1,2  derived  from  the  two 
common  hypotheses  XJ ,  j  =1,2.  Since  X1  and  X2  are  mutually  exclusive,  the  local 
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Figure  2-1:  Fusability  of  Tracks 


hypotheses  Xt2  and  X2*  are  not  fusable. 

The  second  step  in  the  fusion  process  consists  in  generating  the  state  distri¬ 
butions  of  the  global  tracks  and  the  probabilities  of  the  global  hypotheses  using 
the  local  distributions  and  probabilities.  If  the  nodes  communicated  in  the  past, 
the  local  statistics  would  not  be  independent.  A  key  problem  in  fusion  is  to  iden¬ 
tify  the  common  information  shared  by  the  nodes  and  make  sure  it  is  not  used 
more  than  once  in  generating  the  global  statistics. 

2.2  INFORMATION  GRAPH 

In  performing  information  fusion,  it  is  necessary  to  identify  the  information 
available  to  the  nodes  in  the  network  at  various  times  and  how  the  information 
of  one  node  at  one  time  is  related  to  that  of  another  node  at  a  different  timj. 
For  example,  whenever  two  nodes  communicate  some  common  information  is 
shared  between  the  nodes.  The  existence  of  this  shared  information  would  have 
to  be  recognized  in  any  future  information  fusion.  Specifically,  before  any  global 
hypothesis  can  be  generated,  the  fusability  of  the  local  hypotheses  have  to  be 


a  Z  is  called  a  partial  information  set  or  partial  data  set,  or  simply  information 
set  or  data  set.  For  each  Z  there  is  a  K  corresponding  to  the  data  indices  in  Z . 

The  sensors  send  the  data  instantaneously  to  the  nodes  as  soon  as  they  are 
generated.  The  communication  among  the  nodes  can  be  characterized  by  the 
communication  schedule  C  which  is  a  subset  of  TxTxNxN.  An  element 
(t,t',n,n')  means  that  the  communication  transmitted  at  time  t  by  node  n  is 
received  at  time  t 1  by  node  n 

The  information  at  each  sensor  or  node  in  the  DSN  is  affected  by  four  types 
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Figure  2-4:  Cyclic  Communication 


Since  there  is  a  one-to-one  correspondence  between  K  and  Z ,  a  similar  set 
of  observations  can  be  made  for  Z . 


1.  Z,  ={Ze Z  |  (Z,SR  )<«' }  for  all  t'  in  I. 


2.  Z,  C Z(,  if  i  <i\ 


3.  Z,  =  U  Z,,  for  all  i  in  I. 
•  '<* 


4.  Z,  =  U  Z:>  for  all  i  in  I. 


Consider  an  information  node  ioClcR-  This  represents  the  event  that  com¬ 
munication  from  other  nodes  is  received.  Let  /  be  the  sec  of  i  Timediate  predeces¬ 
sor  nodes  for  tg.  The  fusion  problem  is  to  find  the  information  state  of  ig  using 
the  information  states  of  the  nodes  in  /  (and  those  of  other  predecessor  nodes  of 
/,  if  necessary).  As  mentioned  before,  it  is  important  to  identify  the  common 
information  in  the  data  represented  by  /.  This  turns  out  to  be 
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(2.10) 


where 

C  (/)={{'€!  |  ;'<f  for  V  iG/}  (2.11) 


is  the  set  of  common  predecessors  for  all  the  nodes  in  /.  Equation  (2.10)  states 
that  the  common  information  shared  by  the  nodes  in  /  is  the  union  of  the  infor- 
rr.  ation  of  the  common  predecessor  nodes  of  /.  In  fact,  based  on  the  observation 
(4)  above,  C(I)  can  be  replaced  by  CmiX(I)  which  is  the  maximum  set  in  C(I) 
with  respect  to  the  set-inclusion  partial  order  whereby  Ii<It  when  /1C/2  and 
*  x  <  *  2  for  all  it£l  1  and  j2€/2.  Then  the  union  needs  to  be  taken  only  over  the 
set  Cmax(/),  i.e.,  equation  (2.10)  becomes 


U  Kv 


(2.12) 


If  necessary,  we  can  regard  Cmax(/)  as  /  in  equation  (2.12)  and  repeat  the  process 
to  find  the  common  information  shared  by  all  the  nodes  in  Cmax(/).  This  would 
be  used  in  the  following  section  to  develop  distributed  estimation  algorithms. 
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2.2.2  Distributed  estimation 

We  now  consider  the  distributed  estimation  problem  to  illustrate  the  use  of 
the  information  graph.  Any  uncertainty  in  the  origins  of  the  measurements  is 
ignored  for  the  time  being.  The  results  would  be  useful  in  the  next  subsection 
when  we  consider  distributed  multitarget  tracking. 

The  state  to  be  estimated  is  a  random  vector  x .  The  a  priori  probability 
density  (or  distribution)  is  p  ( x ).  The  observation  generated  by  a  sensor  s  at 
time  t  is  z(t  ,s  ).  The  following  additional  assumptions  are  needed: 


•  Both  the  sensor  schedule  K  and  the  communication  schedule  C  are  independent 
of  the  state  x  . 

•  Given  x  and  K,  each  element  in  Z  is  conditionally  independent  from  each  other 
and  has  an  absolutely  continuous  transitional  probability  from  state  x  to  meas¬ 
urement. 


The  distributed  estimation  problem  is  then  to  compute  p  (z  |  Z, )  for  each  i  £L 
From  the  definition  of  7,  this  needs  only  to  be  carried  out  for  the  sets  and 
since  the  only  activities  at  the  other  nodes  involve  transmission.  For  an 
information  node  in  ISR  ,  we  have  a  traditional  Bayesian  update  problem  where 
the  conditional  probability  is  updated  using  the  sensor  report.  We  are  primarily 
interested  in  a  problem  involving  information  nodes  in  .  Suppose  the  infor¬ 
mation  node  of  interest  is  t0  and  that  the  immediate  predecessors  of  t0  form  the 
set  7.  Then 


2„=U4  (2.13) 

i  el 

The  objective  is  the  computation  of  p{x  |  U  Z< )  in  terms  of  the  predecessor  pro- 

iS/ 

babilities  p  (x  |  Z, >),«<,  .  Ideally,  one  would  like  to  use  only  the  probabilities 
defined  on  7 ,  but  as  we  shall  see,  this  is  not  always  possible. 


In  the  appendix  of  [4],  we  showed  that 


p(*  i  u  z,)  =  c  n  i  n  p(i  i  n/,))'-"' 

i=i  i=i  (veN/*  jew 


(2.14) 


where  c  is  a  normalization  constant  and 


N,“  =  {N  C{l,..,n  }  |  #  (N)=i } 


(2.15) 


is  the  set  of  all  subsets  of  }  with  i  elements.  In  equation  (2.15),  #  (N) 

denotes  the  number  of  elements  in  the  set  AT.  For  n  =2,  this  yields  the  fusion 
formula  for  two  nodes: 


P  (* 


Z  \[J  Z  2) —  c 


p(x  |  Zx)p{x  |  Z2) 
p{x  \  Zlf]Z2) 


(2.16) 


Equation  (2.15)  can  be  interpreted  as  follows.  Since  the  probabilities  p  (x  \  Z:) 
and  p  (x  |  Z2)  both  utilize  the  information  contained  in  ZlClZ2,  the  division  by 
p  (x  |  ZxnZ2)  is  needed  to  remove  the  common  information  so  that  it  is  used  only 
once.  Equation  (2.14)  is  just  a  general  form  where  the  probabilities  from  multiple 
nodes  are  to  be  fused.  Unfortunately,  in  both  (2.14)  and  (2.16)  there  are  still 
terms  involving  intersections  of  the  Z,  ’s.  If  all  these  intersections  are  of  the  form 
Zj  for  some  information  node  j  or  empty  corresponding  to  the  common  a  priori 
information,  then  equation  (2.14)  or  (2.16)  serves  as  a  fusion  algorithm.  In  this 
algorithm,  the  conditional  probability  at  the  fusion  node  is  a  product  and  ratio  of 
the  conditional  probabilities  defined  on  a  set  of  predecessor  nodes.  From  the 
definition  of  the  information  graph,  all  these  probabilities  can  be  communicated. 


If  there  is  an  intersection  D  Z ,  which  is  not  equal  to  Z.>  for  some  /'G I, 

ieN  1 

then  by  (2.10)  the  intersection  can  be  expressed  as  the  union  of  the  information 
of  some  information  nodes  again.  Equation  (2.14)  can  then  be  applied  to  evalu¬ 
ate  the  probability  p  {x  |  f|  Z; ).  The  process  can  be  repeated  until  all  the  pro- 

;€JV 

babilities  are  either  conditioned  on  the  information  at  the  individual  information 
nodes  or  the  a  priori  information.  For  notational  convenience,  we  represent  the  a 
priori  information  by  adding  an  element  i  $  to  the  set  I  of  all  the  information 
nodes  and  let  T=IU{»0}-  Then  the  extended  information  graph  (I,<)  is  con¬ 
structed  by  letting  tg  be  the  immediate  predecessor  of  all  the  minimum  nodes  in 
the  original  information  graph  (I,<).  Then  we  have  Zit—Kit= 0.  With  this 
definition  it  can  be  shown  (see  Appendix  of  [4])  that 

p(x  \l)Zt)=C  Jl,(x  |Zr)»(r)  (2.17) 

t  €/  i €/ 

where  I  </  is  a  subset  of  I,  (a(i  ))j-€ j  is  some  index  tuple  such  that  a(i )  is  a 
nonzero  integer  for  each  1 ,  and  C  is  the  normalizing  constant.  The  set  I  con¬ 
tains  all  the  information  nodes  which  are  relevant  to  fusion  at  node  i0.  a(«  ) 
decides  whether  the  information  at  node  «  should  be  added  (a(i)=l)  or  removed 

W»  )=-!)• 


To  illustrate  the  use  of  this  algorithm,  let  us  first  consider  a  broadcast  com¬ 
munication  pattern  of  Figure  2-3.  For  notational  simplicity,  we  would  suppress 
the  type  of  the  node  in  naming  the  node.  Consider  the  information  node  (tCR  ,n ). 
We  have 


n  z  (tcT  ’n  )  —  Z  {tcR  ~  h  >n  )• 

n  €N 

Thus,  the  fusion  algorithm  for  a  node  n  at  time  tCR  is 


(2.18) 


p(r  U((CB,n))-o-iI  ))  I2'19) 

*eN  p  (x  |  /  (tCR  -td  ,t  )) 

where  C  is  a  normalizing  constant.  Each  term  in  the  product  is  the  new  infor¬ 
mation  contained  in  the  sensor  report  z  (tST  ,i ). 

For  the  cyclic  communication  system  shown  in  Figure  2-4,  consider  node  1 
at  time  tCR  .  The  immediate  predecessors  of  the  information  node  ( tCR  ,1)  are 
(fCT,l)  and  (fCT,2).  Equation  (2.16)  can  thus  be  used  to  find  p  (x  \  Z  (tCR  ,1)). 
From  the  information  graph  of  Figure  2-4,  the  common  predecessors  of  (fcr,l) 
and  ( tCT  ,2)  consist  of  the  two  nodes  {tcT  -2^,1)  and  {tCT-td  ,2).  Thus 


Z(tCT  ,i)n  Z  (tCT  ,2)  =  Z  (tCT  -2 td  ,1)U  Z(tCT  -td  ,2), 


(2.20) 


and  equation  (2.16)  can  be  used  to  find  the  probability  of  the  right  hand  side 
again.  From  the  information  graph, 


Z  {tcT  ~2f(f  >l)Tl  Z{tCT -td  ,2)  —  Z  (tcT  >1)U  Z{tCT  -3 td  ,2) 

=  Z(tCR  -3 td  ,1). 

Thus,  the  algorithm  gives  for  general  «  =1,2,3 

p(x  |  Z(lCT,i))  p{x  \  Z  ( tCT  ,[«  +1])) 


(2.21) 


p(x  \  Z  ( tCR  ,« ))  —  C 


p{x  \Z(tCT  -2 td  ,i ))  p  (x  |  Z  (tCT -td ,[»  +1])) 


Xp  ( i  |  Z{tCR  -3 td  )) 


(2.22) 


where  [« ]  is  i  modulo  3. 

This  is  in  the  form  of  equation  (2.17)  with  five  nodes  in  the  set  7.  Thus,  in 
addition  to  its  current  conditional  probability  p  (x  \Z(tCT,l)),  and 
p  (x  |  Z  (ter  ,2))  which  comes  from  node  2,  node  1  has  to  store  three  other  proba¬ 
bilities.  Note  that  p(x  \  Z{tCT-td,2))  is  available  to  node  1  from  earlier  commun¬ 
ications.  This  indicates  that  in  a  distributed  sensor  network,  knowing  the  most 


r'-ent  estimate  may  not  be  sufficient  if  one  wants  to  recover  the  globally  optimal 
.mate. 

Our  discussion  above  assumes  the  fusion  algorithm  for  each  node  is  pro¬ 
vided  by  a  system  designer  based  on  the  information  graph.  Alternatively,  we 
may  assume  that  the  information  graph  is  known  to  all  the  DSN  processing  nodes 
who  then  compute  the  algorithms  in  a  distributed  manner.  Still  another  possibil¬ 
ity  is  for  each  message  to  contain  a  history  of  the  nodes  and  times  that  it  has 
passed  through.  Then  a  fusion  node  can  use  the  histories  of  the  messages 
received  to  construct  a  partial  information  graph  so  that  fusion  can  be  per¬ 
formed.  This  philosophy  would  be  useful  for  fusion  when  the  communication 
pattern  is  not  fixed  a  priori,  such  as  when  nodes  can  vary  their  communication 
strategies  or  have  to  adapt  to  system  failures. 


2.3  FUSION  IN  MULTITARGET  TRACKING 

In  this  section  we  consider  the  fusion  algorithm  for  multitarget  tracking 
assuming  arbitrary  communication  pattern.  The  algorithm  is  based  on  the 
theory  of  multitarget  tracking  developed  under  the  previous  project  [l]  and  the 
concept  of  the  information  graph.  In  the  previous  project  [l],  the  information 
fusion  in  multitarget  tracking  was  investigated  primarily  for  broadcast  type  com¬ 
munication  pattern.  In  this  section,  we  treat  the  same  subject  assuming  an  arbi¬ 
trary  communication  pattern  which  is  defined  in  terms  of  an  information  graph. 

2.3.1  Problem  formulation 

In  Section  2.1  we  introduced  the  fusion  problem  in  general  terms.  We  now 
state  it  more  formally  in  terms  of  an  information  graph.  Given  the  communica¬ 
tion  pattern  of  the  network,  an  information  graph  is  defined.  For  each  informa¬ 
tion  node  «  in  the  graph,  there  is  a  data  index  set  K{  and  an  information  set  or 
data  set  Z,  as  defined  before.  Since  we  are  now  interested  in  multitarget  track¬ 
ing,  we  have  to  deal  with  measurement  index  sets  on  which  tracks  and 
hypotheses  are  defined.  A  measurement  index  set  J,  at  an  information  node  i  is 
defined  as 

Jt  ={(j,k)EJ\kEKi}. 

The  activities  in  a  DSN  can  be  represented  by  the  expansion  of  the  nodes  in  the 
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information  graph,  Two  types  of  nodes,  namely  those  in  I5T  and  I CT ,  involve 
only  communication.  For  the  other  two  types,  namely  the  ones  in  1SR  and  ICfl  , 
information  processing  is  involved.  At  a  node  in  lSR  ,  the  data  received  from  the 
local  sensors  are  processed  by  each  node  using  the  GTC,  producing  an  informa¬ 
tion  state  for  the  node.  For  a  node  t’nGlcT},  messages  are  received  from  other 
nodes  in  the  DSN  and  fusion  takes  place.  Let  /  be  the  set  of  immediate  prede¬ 
cessor  nodes  of  i0.  For  any  node  t  in  /,  assume  the  possible  tracks  T(7, )  and  the 
possible  hypotheses  H(7, )  are  known.  In  addition  to  these,  the  local  probabilities 
of  the  tracks  and  hypotheses  are  also  given.  From  the  information  graph,  the 

measurement  index  set  for  the  information  node  t0  is  J  =  U  •  The  two  specific 

i  ei 

subproblems  in  information  fusion  are  then  the  following: 
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•  (Hypothesis  formation)  How  should  node  «0  construct  the  possible  (global)  track 
set  T(J)  and  the  possible  (global)  hypothesis  set  H (7)  ? 

•  (Hypothesis  evaluation)  Suppose  the  global  sets  of  tracks  and  hypotheses  are 
formed.  How  can  we  evaluate  the  probability  of  each  hypothesis  using  the  pro¬ 
babilities  of  the  predecessor  nodes?  Also,  how  should  the  state  distributions  of 
the  tracks  be  computed? 


The  two  problems  would  now  be  discussed  separately. 

2.3.2  Hypothesis  formation 

As  we  discussed  before  in  Section  2.1,  not  all  local  tracks  and  hypotheses 
can  be  fused  to  form  meaningful  global  tracks  and  hypotheses.  Our  philosophy 
behind  information  fusion  is  to  reconstruct  the  information  state  E(Z)  starting 
from  the  information  states  E (Z. ).  This  means  that  two  tracks  can  only  be  fused 
if  there  exists  a  global  track  which  is  consistent  with  them.  This  is  also  the  idea 
behind  the  fusion  of  hypotheses.  The  following  are  some  definitions  needed  to 
formalize  this  concept. 

Consider  any  two  measurement  index  sets  Jx  and  J2  with  J2C.J v  For  each 
track  t  in  T (J x)  the  restriction  of  the  track  r  on  J2  is  defined  as  tD/2>  i-e->  the 
track  consisting  of  only  those  measurement  indices  in  J 2.  We  usually  say  that 
the  track  r  is  a  successor  of  its  restriction  Tfl/2  or  conversely,  rf]J2  is  the  prede- 


cessor  track  of  r.  Similarly,  for  each  hypothesis  X  in  H^),  the  restriction  of  the 
hypothesis  X  on  J2  is  defined  to  be 


X  |  J2  =  {7fW2  |  t€X}5S{0} 


(2.23) 


i.e.,  a  hypothesis  whose  tracks  are  those  of  X  restricted  to  J2-  The  concepts  of 
predecessor  and  successor  hypotheses  can  be  defined  as  in  tracks. 

Let  be  an  arbitrary  tuple  of  measurement  index  sets  where  /  is  an 

arbitrary  nonempty  set.  (I  does  not  have  to  be  related  to  the  information  graph 

at  all.)  Then  any  tuple  (r,  ),-6/  of  tracks  in  IlT(7, )  is  said  to  be  fusable  if  there 

•  e  / 

exists  a  track  r  in  T(  U  J, )  such  that 
<e/ 


hi  J,  =  rt 


(2.24) 


for  all  i£l .  r  is  a  track  obtained  by  fusing  the  tracks  in  the  tuple.  Similarly  any 

tuple  (X, ).  e/  of  hypotheses  in  IlH(X)  is  said  to  be  fusable  if  there  exists  a 

« ei 

hypothesis  X  in  H(  U  X )  such  that 
iei 


XIX  =  X, 


(2.25) 


for  all  i£l.  Fusability  of  tracks  thus  means  that  there  exists  a  possible  global 
track  such  that  each  of  the  local  tracks  represents  a  restriction  of  the  global  track 
to  the  local  measurement  indices.  Similarly  the  fusability  of  the  hypotheses 
means  there  exists  a  global  hypothesis  such  that  each  local  hypothesis  is  a  restric¬ 
tion  of  the  global  hypothesis  to  the  local  measurement  index  set,  or  more 
specifically,  the  nonempty  restrictions  of  the  tracks  in  the  global  hypothesis  are 
the  local  hypotheses. 

If  the  measurement  index  sets  (J,  ),e/  do  not  intersect,  fusability  of  tracks 
and  hypotheses  is  trivially  assured.  When  the  measurement  index  sets  do  over¬ 
lap,  we  have  to  be  concerned  about  the  consistency  in  the  tracks  and  hypotheses. 
The  following  rather  intuitive  conditions  for  checking  fusability  are  proved  in  the 
appendix. 


1.  Any  track  tuple  (r,  ),€/  in  nT(X  )  is  fusable  if  and  only  if 

•  €/ 


for  all  (i'i,i'2)€/  X/. 
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(2.26) 


-r.  -v-v'-w. 


(2.27) 


2.  Any  hypothesis  tuple  (X,  ),  e/  in  )  is  fusable  if  and  only  if 

■  ei 

x,-Ii(JilnJi1)  =  xiii(jil  rug 

for  all  2)G/  X/. 

These  two  conditions  state  that  a  tuple  of  tracks  (or  hypotheses)  is  fusable  if  and 
only  if  they  share  common  predecessors  (in  tracks  or  hypotheses)  in  the  overlap¬ 
ping  measurement  index  set 

7  =  U  {7,^07, ,  I  (»!,» 2)e/X/  such  that  i^i2}  (2.28) 

To  check  the  conditions  described  by  (2.27)  or  (2.28),  we  need  to  have  tracks  and 
hypotheses  defined  on  the  set  7.  In  general,  these  are  not  directly  available  since 
there  may  not  be  any  information  node  with  7  as  its  measurement  index  set. 
However,  by  using  the  decomposition  algorithm  of  equation  (2.10),  we  can  express 
the  set  7  as  the  union  of  the  measurement  index  sets  of  some  predecessor  nodes 
in  the  information  graph.  The  two  fusability  conditions  of  equations  (2.26)  and 
(2.27)  can  be  further  reduced  to  the  following. 

Let  «o  be  a  communication  receiving  node  and  /  be  the  set  of  all  the 
immediate  predecessors  of  it.  For  each  (*i»*2)€/X/,  let  T(tvi2)  be  a  set  of  infor¬ 
mation  nodes  i  such  that  i  <  i  {  and  «  <  *  2»  be.,  their  common  predecessor  nodes. 
Then,  we  have 

1.  a  necessary  and  sufficient  condition  for  any  track  tuple  (r,  ),  6/GllT(7i )  to  be 

•  6/ 

fusable  is  that,  for  any  (t  i,t2)€/X/, 

ri.n/(r)  =  r(,rU(f)  (2-29) 

for  any  » G/(i'i,i2),  and 

2.  a  necessary  condition  for  any  hypothesis  tuple  (X< ),  6/ gIIH^  )  to  be  fusable 

i  6/ 

is  that,  for  any  («i,*2)€/  X/, 

x„  I  •'in  =  x.,  I  '(<)  (2-30) 

for  any  i  eT{i  ut  2). 
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In  general,  for  any  two  distinct  nodes  i  t  and  i  2,  their  common  predecessor 
set  T[ivi 2)  may  not  be  unique.  However,  to  use  the  above  conditions  to  test  the 
fusability,  we  need  only  to  consider  the  set  of  all  the  maximum  elements  in  the 
set  {f€l  |  i’<i1andt'<i2},  be.,  the  maximum  common  predecessor  set.  Thus  in 
the  cyclic  communication  example  of  Figure  2-4,  a  track  from  the  node  (tCR  ,1) 
and  one  from  the  node  (tCR  ,2)  are  fusable  if  and  only  if  they  have  the  same 
predecessor  (or  restriction)  tracks  in  both  the  nodes  (£cr-2,l)  and  ( ter  -1)2). 

The  test  defined  by  (2.29)  provides  a  necessary  and  sufficient  condition  for 
track  fusability  but  equation  (2.30)  only  provides  a  necessary  condition  for 
hypothesis  fusability.  This  is  due  to  the  fact  that  a  fusable  tuple  of  tracks  pro¬ 
duces  only  one  fused  track  but  a  fusable  tuple  of  hypotheses  may  produce  more 
than  one  hypotheses.  The  counterexample  in  Figure  2-5  shows  that  (2.30)  is  not 
a  sufficient  condition  for  the  hypothesis  fusability.  In  this  example,  the  two 
hypotheses  (X1,X2)  are  to  be  fused.  The  common  predecessors  of  the  nodes  j d 
2  are  nodes  3  and  4.  It  is  obvious  that  Xj  |  J  |  J 3  and  also  Xt  |  /4=X2  |  J 4, 


*3=lTCI.Tb}  *l  =  lToUTd,Tb  Tc\ 


Figure  2-5:  Counter  Example 
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ying  the  necessary  condition  of  (2.30)  for  hypothesis  fusability.  In  fact, 
e  since  both  Xi  and  X2  are  the  results  of  fusing  X3  and  X4.  However, 


^1  I  Jf\Ji  ^  ^2 1  J  3CI  J  4 


(2.31) 


hesis  fusability  condition  of  (2.27)  is  violated.  This  is  again  obvious 
since  Aj  and  X2  are  mutually  exclusive.  Xj  hypothesizes  that  ra  and  rd  are  from 
the  same  target  whereas  X2  hypothesizes  that  ra  and  rd  are  from  different  targets. 

Although  it  is  not  sufficient  to  determine  hypothesis  fusability  by  consider¬ 
ing  only  the  predecessors  of  the  hypotheses  in  the  predecessor  nodes,  the  condi¬ 
tion  (2.30)  can  be  used  to  eliminate  hypotheses  for  further  consideration  if  they 
do  not  have  the  same  predecessor  hypothesis  in  a  common  predecessor  node. 
Furthermore,  the  following  equivalence  condition  (proved  in  the  appendix  of  ’4]) 
relates  hypothesis  fusability  to  track  fusability. 

Hypothesis  Fusability  Condition.  Let  (./j)l€/  be  any  tuple  of  measurement  index 
sets  and  J  =  U  1- .  Then,  anv  fXA^-r  pTThij  \  is  fusable  with  fused  hvnnt, hesis 


i|CAj  ,  i/ueie  cAists  a  r  iu  a  sucu  tu<u  rt- 


rery  track  r  in  the  hypothesis  X  is  formed  by  taking  the 
s  in  the  local  hypotheses.  Condition  2  states  that  every 
bal  track  in  anv  eiven  elobal  hvDothesis. 


ivumiir 


y  condition  of  (2.29)  to  further  determine  hypothesis 


able  hy  pothesis  tuples,  and  for  each  fusable  hy  ;othesis 
ble  fused  hypotheses. 


with  the  actual  hypothesis  formation  and  consists  of  a 
first  level  performs  hypothesis-to-hypothesis  associa¬ 
tes  out  the  actual  track-to-track  association  to  form 
,ble  track  tuples. 


' 


Each  L  (t,(Z-)j-ej)  is  a  track-to-track  association  likelihood,  i.e.,  the  likeli¬ 
hood  of  associating  all  the  tracks  in  the  local  track  tuple  with  one  tar¬ 

get  represented  by  the  global  track  r  which  is  their  union.  Its  evaluation  depends 
on  the  state  distributions  of  the  local  tracks.  If  the  tracks  have  similar  state 
descriptions  then  the  integrand  in  equation  (2.33)  will  be  large,  thus  resulting  in  a 
high  likelihood.  On  the  other  hand,  if  the  local  tracks  have  state  descriptions 
which  are  very  different,  the  integrand  in  (2.33)  will  be  small,  resulting  in  a  low 
likelihood.  In  equation  (2.33),  the  function  p  (x  \  t,Zj)  is  identical  to  p  (x  |  r,Zj), 
the  state  distribution  for  track  r,  when  the  track  t  has  a  nonempty  restriction  at 
the  node  i .  When  this  is  not  the  case,  i.e.,  the  track  r  has  not  been  detected  yet 
at  T,  the  function  ~p  is  scaled  by  the  expected  number  of  undetected  targets  and 
is  no  longer  a  probability  distribution.  It  represents  some  kind  of  density  for 
undetected  targets. 

Equation  (2.34)  computes  the  expected  number  of  undetected  targets  by 
fusing  the  local  track  state  distributions  of  the  undetected  targets.  Equation 
(2.37)  is  the  fusion  formula  for  the  global  track  state  distribution.  Note  that  it 
has  the  same  form  as  (2.17).  This  is  not  at  all  surprising  since  given  a  particular 
track,  computing  the  state  distribution  of  the  target  is  the  usual  estimation  prob¬ 
lem.  Thus  the  fusion  algorithm  for  distribution  estimation  is  an  integral  part  of 
fusion  for  multitarget  tracking. 


2.4  CONCLUSION 

In  this  section,  we  have  described  the  results  of  our  research  on  information 
fusion  for  multitarget  tracking.  We  have  identified  two  main  problems  in  infor¬ 
mation  fusion  assuming  arbitrary  communication.  The  first  is  how  to  generate 
meaningful  tracks  and  hypotheses  starting  from  a  set  of  local  tracks  and 
hypotheses.  The  second  is  how  to  compute  the  statistics  on  these  tracks  and 
hypotheses  when  the  local  quantities  may  contain  common  information  due  to 
past  communication. 

We  have  developed  an  abstract  model  of  the  DSN  in  terms  of  the  informa¬ 
tion  graph.  Using  this  graph,  algorithms  for  information  fusion  have  been 
developed.  The  two  problems  of  hypothesis  formation  and  evaluation  all  require 
keeping  around  histories  of  the  tracks  and  hypotheses  in  the  system.  Using  this 
history,  the  fusability  of  tracks  and  hypotheses  can  be  determined.  At  the  same 
time,  any  common  information  shared  by  their  statistics  can  be  identified  so  that 
it  would  not  be  double-counted.  When  specialized  to  broadcast  communication, 
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3.  DISSIMILAR  SENSORS  AND  ATTRIBUTE  BASED  TRACKING 


The  algorithms  presented  in  Section  2  are  quite  general  and  apply  to  arbi¬ 
trary  target  models  as  long  as  the  target  motions  are  independent.  In  this  sec¬ 
tion,  we  consider  the  case  when  the  different  nodes  in  the  DSN  have  sensors  of 
different  types.  For  example,  one  node  may  have  sensors  which  observe  a  certain 
set  of  features  while  another  nodes  may  have  sensors  which  observe  a  different  set 
of  features  (e.g.,  radar  versus  acoustic).  In  general,  the  sensor  produces  data 
which  contain  attribute  information  as  well  as  kinematic  information.  Typical 
attributes  may  include  wheel  or  tread  type  of  ground  vehicles,  radar  images  of 
ships,  engine  type  of  aircraft,  and  different  types  of  electronic  emissions. 

This  tracking  problem  with  dissimilar  sensors  is  both  interesting  from  a 
theoretical  and  practical  point  of  view  since  correlation  of  results  from  multiple 
sensors  can  often  yield  useful  information  not  available  from  a  single  sensor.  In 
particular,  by  considering  attributes  from  multiple  sensors,  it  may  be  possible  to 
determine  the  type  of  the  target. 

In  this  section,  we  consider  the  problem  of  tracking  and  classifying  targets 
when  the  nodes  in  the  DSN  have  sensors  of  different  types.  Such  targets  usually 
have  states  which  contain  some  structural  information  (e.g.,  a  givpn  target  type 
may  contain  certain  features  which  in  turn  contain  other  subfeatures).  The  rela¬ 
tionship  between  targets  with  structured  states  and  general  structured  set  of  tar¬ 
gets  will  be  discussed  in  Section  4. 

3.1  TARGET  AND  SENSOR  MODELS 

We  assume  that  the  sensors  at  various  DSN  nodes  have  different  capabili¬ 
ties  and  in  particular,  no  single  node  can  classify  the  target  type  uniquely.  Thus, 
the  nodes  have  to  cooperate  to  achieve  the  overall  mission.  If  this  is  not  the  case, 
then  the  results  of  Section  2  apply.  Each  node  performs  its  local  tracking  and 
classification.  Cooperation  among  the  nodes,  while  it  may  improve  the  quality  of 
the  results,  is  not  really  necessary.  There  are  also  other  situations  when  the 
nodes  have  identical  sensors  (e.g.,  acoustic  or  infrared)  but  the  targets  are  not 
observable  from  a  single  sensor.  In  this  case,  cooperation  among  nodes  is  also 
needed.  An  example  of  this  acoustic  tracking  will  be  presented  in  Section  5. 
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3.1.1  Target  Models 

We  assume  that  each  target  has  a  state  z(t)  at  time  t  which  evolves 
according  to  some  dynamical  model.  The  state  x  (t)  is  represented  by 
(x c  (f  ),xd(t )),  where  xc  (t)  is  the  continuous  part  representing  its  geolocation 
quantities  such  as  position,  velocity,  etc.,  while  xd(t)  is  the  discrete  part 
representing  other  attributes.  xc  (f )  is  usually  modeled  by  means  of  dynamical 
equations  such  as: 

ic{t)  =  Fxc(t)  +  w(t)  (3.1) 

where  w(t)  is  a  white  driving  noise.  The  components  of  x  d  usually  have  some 
internal  structure.  For  example,  xd  may  consist  of: 

xd  =  (xd0,xdl,xd2)  (3.2) 

where 

•  xd0  is  the  type  of  the  vehicle  (tank  or  armored  personnel  carrier  (APC),  or 
truck) 

•  xdl  is  the  attribute  corresponding  to  the  wheel  type  (tread  or  wheel) 

•  x  d  2  is  the  attribute  corresponding  to  the  weapon  carried  on  the  vehicle  (gun  or 
no  gun) 

The  discrete  states  are  related  as  in  Figure  3-1  where  the  state  xd0  determines 
the  states  xix  and  xi2,  i.e.,  the  type  of  the  vehicle  determines  the  wheel  type  and 
the  presence  (absence)  of  guns  as  in  Figure  3-1.  In  some  cases,  the  relationship 
between  the  discrete  states  may  also  be  probabilistic  as  given  by  p(xdl,xd2  |  xd0). 
For  example,  one  type  of  vehicle  may  have  a  given  radio  with  certain  probability. 
The  probability  of  the  attributes  is  sometimes  conditionally  independent,  i.e., 

p(xd\xd2\xd0)  =  p(xdl\xd0)p(xd2\xd0)  (3.3) 

which  may  simplify  the  processing  considerably.  In  other  cases,  some  discrete 
states  themselves  (other  than  the  target  type)  may  evolve  with  time  and  depend 
on  other  states,  e.g,  the  electronic  emission  of  a  target.  The  dynamic  behavior 
may  be  modeled  by  a  Markov  process. 


ATTRIBUTE 


WHEEL  TYPE 

TREAD 

TREAD 

WHEEL 

GUN  TYPE 

GUN 

NO  GUN 

NO  GUN 

Figure  3-1:  Example  of  Structured  State 


fferent  DSN  nodes  may  have  different  capabilities, 
the  kinematic  Quantities  while  others  mav  measure 


3.2  LOCAL  PROCESSING 


Local  processing  follows  the  algorithms  presented  in  Section  2.1.1,  using  the 
appropriate  sensor  model  for  each  node.  Each  node  has  an  information  state 
represented  by  the  set  of  tracks,  set  of  hypotheses,  track  state  distributions  and 
hypothesis  probabilities.  Equation  (2.2)  is  used  for  hypothesis  evaluation  with 
the  likelihoods  given  by  (2.3)  to  (2.5).  Since  not  all  the  states  of  the  targets  are 
observable  from  the  sensor  j ,  the  state  x  should  be  replaced  by: 

XJ  =(x',xd>)  (3.7) 

where  xc  is  the  continuous  (geolocation)  state  and  x d’  is  the  discrete  state  of 
attributes  observable  from  sensor  j .  The  relevant  tracks  state  distribution  is 
then  (with  some  independence  assumptions  on  the  states  and  measurements) 

P,  (l  ’■  I  r,Z,  )  =  p(x‘  \r,Zj ),  (x  ‘‘  |  r ,2; )  (3.8) 

When  the  target  and  sensor  models  for  the  continuous  state  satisfy  linear 
and  Gaussian  models,  the  geolocation  component  of  the  track  state  description 
can  be  computed  by  means  of  the  Kalman  Filter.  The  discrete  component  is 
computed  using  a  Bayesian  updating  formula.  Assuming  xdi  is  static,  then 

p(i''  |  T,Zj)  =  C  -‘Pm  (,/  I  x  "  )p  («  »  1 7,2,. )  (3.9) 

where  C  is  a  normalization  constant,  pm(-)  is  the  discrete  measurement  model 
and  p  (xdi  |  T,Zj)  is  the  predicted  discrete  state  given  the  previous  measurements. 

For  the  example  of  Figure  3-1,  each  hypothesis  from  the  wheel  type  sensor 
node  will  contain  the  number  of  targets  detected,  their  positions  and  velocities 
and  possible  classifications  into  wheel  and  tread  vehicles  (with  probabilities). 
Similarly,  the  gun  type  sensor  generates  hypotheses  with  tracks  described  by  gun 
type  as  well  as  locations  and  velocities. 

3.3  INFORMATION  FUSION 

When  sensor  nodes  have  the  same  type  of  sensors,  communication  among 
nodes  serves  primarily  to  reduce  the  uncertainty  associated  with  the  situation 
assessment  at  each  node.  For  example,  nodes  1  and  2  may  have  different  esti¬ 
mates  of  a  target  given  by  x,c,E,  ,p,-  (x d )),  *  =  1,2,  where 


where  we  have  assumed  that  the  attributes  xil  and  xd2  depend  only  on  xd0  and 
C 2  is  a  normalization  constant. 

Equation  (3.14)  is  the  standard  equation  for  fusing  two  probability  distribu¬ 
tions  of  the  same  random  state.  Equation  (3.15)  fuses  the  probability  distribu¬ 
tions  of  different  attributes  to  obtain  that  of  all  attributes.  The  last  factor  in 
(3.15)  represents  the  a  priori  estimate  of  the  attribute  xd0  (vehicle  type)  based  on 
Z.  It  is  the  marginal  probability  of  p  (x d  °,x d  1,x  d  2  |  Z)  computed  from  an  earlier 
fusion.  The  factor  p(xdl,xd2  j  xd0)  is  the  model  of  the  structured  state.  For  the 
example  in  Figure  3-1,  we  may  have 

p  (x  d  1  =  tread,  x  d  2  =  gun  |  x  d  0  =  tank)=l 


p  [  x  dl  —  tread,  x  d  2  =  no  gun 


=  APC)=1 


p  (x  d  1  =  wheel,  x  d  2  =  no  gun  |  xi0  =  truck)=l 


(3.16) 


and  zero  otherwise.  The  last  two  factors  in  equation  (3.15)  together  predV,  vhe 
target  attributes  from  the  previous  communication  time.  The  first  two  factors  in 
the  numerator  represent  the  estimates  of  the  two  attributes  from  the  two  nodes. 
Since  these  estimates  share  some  information  with  the  predicted  values  through 
Z ,  the  factors  in  the  denominator  are  used  to  remove  any  redundant  information. 
To  obtain  an  estimate  of  the  target  type,  one  needs  only  to  sum  over  the  possible 
values  of  x d  1  and  x  d  2  to  obtain  p  {x  d  0  |  Z ). 


Fusion  Without  Coordination 


If  there  is  no  feedback  from  the  fusion  node  to  the  other  nodes,  then  Equa¬ 


tion  (3.14)  should  be  replaced  by 


P{xc  i z)=c{i  —  jzy  p(x<  i z) 

p(x'  \Zx)p{x'  |Z2)M 


(3.17) 


where  C  x  is  a  normalization  constant,  Z,  is  the  cumulative  data  of  Node  i  before 
the  last  communication  to  the  fusion  node.  This  fusion  formula  is  a  special  case 
of  the  general  Equation  (2.17). 
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where  C2  is  another  normalization  constant.  This  equation  is  similar  to  (3.15) 
except  for  the  terms  in  the  denominator  which  now  depend  on  Zx  and  Z2  instead 
of  Z .  The  reason  for  using  the  different  terms  can  be  seen  by  drawing  the  infor¬ 
mation  graphs. 

So  far  we  have  assumed  that  the  fusion  node  does  not  have  any  measure¬ 
ments  of  its  own.  If  this  is  not  the  case,  as  when  the  sensor  measures  the  type 
xd0  discrete,  then  the  fusion  equations  can  be  modified  appropriately.  The  distri¬ 
buted  hierarchical  Bayesian  Approach  of  [5]  can  also  be  used  to  estimate  the 
attributes  in  the  target  state.  Although  such  an  approach  also  has  a  distributed 
implementation,  it  is  not  as  convenient  as  the  approach  used  here  if  data  associa¬ 
tion  also  has  to  be  considered. 

3.3.2  Hypothesis  Evaluation 

In  the  previous  section,  we  have  considered  the  fusion  of  state  (both  con¬ 
tinuous  and  discrete)  estimates  for  the  individual  target  tracks.  In  multitarget 
tracking,  the  main  problem  is  data  association  and  track  association  in  the  case 
of  multiple  sensor  nodes.  Thus,  wo  -  -?ed  to  evaluate  the  probability  of  each 
track-to-track  association  hypothesis.  The  general  hypothesis  evaluation  formula 
(Equation  (2.32))  is  applicable  to  this  special  case.  We  again  illustrate  the  algo¬ 
rithm  with  the  example  of  Figure  3-1. 


Fusion  with  Coordination 


The  hypothesis  evaluation  equation  is 


P(\  |  Z)=C 


f(Xi|Z|)P(\2|Z,) 

P(\\Z) 


(3.19) 


where  the  probabilities  P  (X,  |  Z, ),  X  =  1,  2,  are  communicated  from  nodes  1  and 
2  to  the  fusion  node,  P(X|z)  is  the  a  priori  probability  of  the  predecessor 


hypothesis  at  the  fusion  node,  and  C  is  a  normalization  constant. 

The  track-to-track  association  likelihood  L  r  can  be  derived  from  Equation 
(2.33)  and  is  given  by 


p(x  |  !-!,£,)>  (z  |  T2,Z  2) 
p(x  \T,Z) 


) 


(3.20) 


where  rt  and  r2  are  tracks  where  are  fused  t  ,n  r  and  p(-)  is  as  defined  in 
Equation  (2.35).  The  likelihood  \T  can  be  further  decomposed  into  two  likeli¬ 
hoods 


l  =  lc  ld 

*  r  4  r  ‘  r 


(3.21) 


where  ler  is  the  likelihood  computed  from  the  continuous  state  and  if  is  com¬ 
puted  from  the  discrete  state.  The  continuous  likelihood  is  given  by: 

p(xc  |  rlfZi)p(xe  |  t2,Z2) 


p(x  I  T.Z  ) 

and  depends  on  how  close  the  geolocation  state  estimates  of  the  two  tracks  are. 
The  discrete  likelihood  is  given  by 


[d  _  yj  p(xdl  |  Tl,Zl)p(xi2  1  r2,Z2) 
r  p(xJ1  |  r,Z)p(xd2 \T,Z) 

p(xd\xd2  I  xd0)p(xd0  I  r,Z) 


(3.23) 


and  depends  on  how  well  the  attribute  estimates  from  the  two  nodes  match  the 
prior  estimate  of  the  target  type  according  to  the  model  of  the  structured  state. 

Note  that  the  likelihood  computation  is  closely  coupled  to  the  fusion  of  the 
track  state  estimates  from  the  similarity  between  Equations  (3.14)  and  (3.22),  and 
between  (3.15)  and  (3.23).  In  fact,  the  normalization  constants  in  Equations 
(3.14)  and  (3.15)  are  the  likelihoods.  Thus,  likelihood  computation  and  track 
state  fusion  are  usually  performed  at  the  same  time. 


Fusion  Without  Coordination 

In  the  case  where  there  is  no  feedback  from  the  fusion  node,  the  hypothesis 
evaluation  equation  is  given  by 

P(M  z) = C"1  jk I  f£gr !  It  P{1 1 ^  (3-24) 

P(Xi  |  Z i)P  [\2  |  Z 2) 
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where  P  (X,  |  Z, )  is  defined  as  before,  X,  is  the  restriction  of  the  hypothesis  X,  to 
Z,  and  P  (X;  |  Z, )  is  the  probability  of  the  hypothesis  X^  before  communication  to 
the  fusion  node; 


The  track-to-track  association  likelihood  lT  again  can  be  decomposed  into: 


l  =  lc  ld 

1  r  1  r  ‘  r 

where  the  continuous  likelihood  is  given  by 

pi1'  I  ’1<Z\ )p '  I'uZi) 


“/ 


p  (x e  |  r,Z)dx  1 


p(ic  |  r,Z1)p(xc  |  r,Z2) 

and  the  discrete  likelihood  is  given  by 

{d  =  yj  p(xil  I  ri>^i)p(*'2  I  ^2) 
p(x^  |T1,Z1)p(x,i2  |  r2,Z2) 

p(x'V2|x'°)p(x'°|Z) 


(3.25) 


(3.26) 


(3.27) 


As  in  the  fusion  with  coordination  case,  the  likelihood  computation  and  track 
state  fusion  operations  can  be  performed  together.  Note  the  similarity  of  these 
equations  to  those  used  for  fusion  with  coordination.  Equations  (3.23)  and  (3.27) 
are  almost  the  same  except  for  the  conditioning  of  the  information  in  the  denomi¬ 
nator.  In  both  cases,  the  structural  relationship  between  the  discrete  states  is 
used  to  evaluate  the  likelihood  of  association. 


3.4  CONCLUSION 

In  this  section,  we  have  applied  the  general  results  of  Section  2  to  the  case 
of  nodes  with  dissimilar  sensors.  When  an  individual  node  can  only  observe  cer¬ 
tain  attributes  of  the  target  state,  cooperation  among  nodes  observing  different 
attributes  can  improve  the  performance  of  the  system  significantly.  By  exploiting 
knowledge  on  the  structured  state,  the  receiving  node  can  assess  some  missing 
attributes  such  as  the  target  type. 

We  have  presented  the  fusion  results  via  a  specific  example  and  communica¬ 
tion  structure.  The  algorithms  for  handling  more  general  cases  cn  be  developed 
along  the  same  principles.  The  fusion  algorithms  consist  of  two  closely  coupled 
operations:  fusion  of  target  state  estimates  and  evaluation  of  association  likeli¬ 
hoods.  For  the  continuous  states  (position,  velocity)  these  operations  are  the 
same  as  the  case  of  similar  sensors.  The  discrete  states,  however,  involve 
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dge  of  the  structured  state.  Therefore, 
targets  with  structured  states  and  dis- 
lifferent  levels.  In  practice,  however, 
utes  may  be  very  complicated  and  the 
y  too  many  to  handle  in  a  straightfor- 
iditional  tools  to  effectively  store  and 
le  entire  terminal  nodes.  In  6j  and  7], 
is  is  shown  by  means  of  an  example  of 
nanagement  procedures  devised  for  con- 
ise  described  in  [6]  and  being  developed 


4.  TRACKING  AND  CLASSIFYING  STRUCTURED  TARGETS 


By  structured  targets,  we  may  mean  two  different  concepts  in  multitarget 
tracking: 

(1)  targets  with  structured  states 

(2)  structured  sets  of  targets. 

Since  each  individual  target  may  be  represented  on  an  individual  target  space, 
concept  2  is  one-level  higher  than  1.  In  a  model  based  on  the  above  concept  1, 
targets  are  still  treated  as  individual  objects  although  correlation  among  them 
can  be  considered  and  targets  may  be  governed  by  a  common  state  as  a  group  of 
targets.  This  kind  of  models  is  necessary,  when  a  multilevel  identification  process 
for  each  target  is  used  or  when  a  target  has  structured  features.  Such  issues  are 
related  to  the  problem  of  treating  dissimilar  sensors  which  generate  measure¬ 
ments  corresponding  to  different  levels  of  the  structured  target  state  space.  This 
problem  has  been  discussed  in  Section  3. 

On  the  other  hand,  concept  2  is  essential  when  targets  are  in  fact  organized 
and  structured  in  units  at  various  levels.  A  typical  example  can  be  found  in  mili¬ 
tary  units  such  as  army  -+  division  — ►  regiment  — ►  battalion  — ►  company,  etc.,  in 
the  military  hierarchy.  In  such  a  case,  the  number  of  targets  is  typically  very 
large  and,  if  they  are  treated  as  independent  objects,  we  may  not  be  able  to 
assess  a  global  situation  based  on  the  outputs  from  any  reasonably  functioning 
target  tracking  system.  This  is  so  because,  since  grouped  targets  are  usually 
closely  spaced,  the  data-to-data  association  (or  scan-to-scan  correlation)  may 
become  very  difficult  with  limited  computational  resources.  This  difficulty  may 
be  overcome  only  when  the  unit  structure  of  targets  is  understood  and  taken  into 
account  in  a  tracking  system.  Moreover,  the  global  assessment  of  all  the  targets 
as  a  single  structured  object  is  itself  an  important  task  in  many  applications. 

Our  emphasis  has  been  the  development  of  a  general  theory  upon  which  we 
may  produce  effective  algorithms  in  many  different  applications.  This  should 
serve  also  as  a  basis  for  developing  distributed  algorithms.  Sectior  11  discusses  a 
general  model  for  structured  set  of  targets.  In  Section  4.2,  we  will  present  our 
first-cut  analysis  on  structured  sets  of  targets.  An  algorithm  is  derived  for  two- 
level  structured  targets,  i.e,  tracking  groups  of  targets.  The  future  direction  of 
our  algorithm  development  effort  will  be  discussed  in  the  concluding  Section  4.3. 


4.1  MODEL  FOR  STRUCTURED  SETS  OF  TARGETS 


A  typical  example  of  a  structured  set  of  targets  is  shown  in  Figure  4-1  m 
which  a  division  in  an  army  is  shown  in  a  simplified  way.  Depending  on  the  type 
of  the  division,  the  composition  and  the  number  of  subordinates,  i.e. ,  battalions 
have  a  certain  pattern.  The  same  kind  of  dependence  is  also  present  in  the  rela¬ 
tionship  between  the  subsequently  lowei  levels.  This  kind  of  structure  produces 
another  dimension  to  the  multitarget  tracking  problems.  There  are  only  very  few 
theoretical  results  on  tracking  and  classification  of  structured  sets  of  targets. 
Besides  a  few  documents  referred  in  [8],  we  can  only  refer  to  a  couple  of  technical 
references,  [9]  and  [10],  both  of  which  are  concerned  with  two-level  tracking,  i.e., 
tracking  of  groups  of  targets,  but  treat  issues  pertaining  multiple  groups  in  a 
rather  ambiguous  manner.  On  the  other  hand,  AI  (Artificial  Intelligence)  -type 
approaches  were  used  in  much  more  complicated  environments  in  [ll]  and  [12] 
which  are  concerned  with  ocean  surveillance  and  battlefield  unit  identification, 
respectively,  [ll]  uses  a  single-hypothesis  propagation  combined  with  a 
backtracking-like  recovery  scheme  while  [12]  adopts  a  multi-hypothesis  approach. 
The  systems  described  in  [ll]  and  [12]  may  be  viewed  as  hierarchical  systems 
which  may  be  illustrated  as  in  Figure  4-2.  The  procedures  represented  by 
upward  arrows  are  often  called  bottom-up  or  induction  processes  and  those 
represented  by  downward  arrows  top-down  or  deduction  processes. 

While  the  decomposition  illustrated  by  Figure  4-2  is  certainly  a  key  to  suc¬ 
cessful  implementation  of  the  systems  described  in  [ll]  and  [12],  each  hypothesis 
evaluation  cannot  be  performed  independently  in  general.  For  example,  in  track¬ 
ing  groups  of  targets,  we  must  hypothesize  possible  group  formation  from  input 
data  while,  at  the  same  time,  the  states  as  a  group  must  be  determined  and  then 
the  estimation  of  the  states  affects  the  evaluation  of  lower  level  hypotheses.  Even 
if  the  bottom-up/ top-down  updating  is  clearly  defined,  iterations  may  be  neces¬ 
sary  for  such  processes  to  converge.  Moreover,  in  some  cases,  a  simple  bottom-up 
type  process  may  easily  be  overwhelmed  by  combinatorics.  Therefore,  at  least 
for  the  few  lower  levels,  we  may  need  an  integrated  approach  rather  than  a 
decomposition  approach  taken  in  [ll]  and  [12].  In  the  subsequent  subsections,  we 
will  try  to  establish  a  first-cut  analysis  which  treats  the  whole  structure  of  targets 
in  an  integrated  manner. 
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Figure  4-2:  Hierarchical  Hypothesis  Evaluation 
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(a)  Single-Level  Targets 


the  groups  into  multiple  super-groups,  and  so  forth.  In  other  words,  a  level-/' 
target  is  an  element  of  a  partition  of  the  set  of  all  the  level-(/'-l)  targets.  The 
partition  is  a  trivial  one  when  /'=/.  In  typical  battlefield  units  as  shown  in  Fig¬ 
ure  4-4,  each  unit  has  its  headquarter  (division  command  post  (DCP),  regiment 
headquarter  (RH),  battalion  headquarter  (BH),  etc.)  besides  its  subordinates  (R  = 
a  regiment,  B  =  a  battalion,  C  =  a  company,  etc.).  These  headquarters  may  be 
considered  either  (l)  as  a  part  of  the  common  state  of  each  level-/'  target  or  (2) 
as  special  targets  which  do  not  have  any  subordinate.  When  we  adopt  the  latter 
consideration,  we  may  simply  extend  each  headquarter  node  to  the  lowest  level, 
i.e.,  level  0.  As  mentioned  before,  as  a  first-cut  analysis,  we  ignore  such  prob¬ 
lems.  There  will  be  no  problem  in  rectifying  the  formulation  to  treat  headquar¬ 
ters  in  appropriate  ways  in  the  future. 

4.1.2  Sensor  Models  and  Multi-Level  Tracks  and  Hypotheses 

We  can  extend  our  target-sensor  model  for  multitarget  tracking  from 
single-level  cases  to  multi-level  cases  in  a  rather  straightforward  way  as  follows: 
Let  5  be  a  finite  set  of  sensors  which  observe  the  targets.  For  each  sensor  s  ,  the 
measurement  value  space  Y,  in  which  measurements  from  sensor  s  take  values  is 
assumed  to  be  a  hybrid  space.  Each  output  from  sensor  s  is  a  data  set 
(y ,  ym  m  ,t  ,s  )  which  is  an  element  of 

0° 

U  U  (T,  )m  X{m  }x[/o.°°)X{s  } 

m  =0  i  6S 

and  represents  m  measurements,  yv . ,ym,  generated  by  sensor  s  at  time  t.  [t0 

is  the  time  before  which  no  sensor  outputs  any  data  set.)  A  collection  of  data  sets 
available  up  to  a  certain  time  is  called  a  cumulative  data  set.  We  assume  that  all 
the  data  sets  are  indexed  by  positive  integers  as  z(l),z(2), . .  where 

« (» )  = «»,  (*  I)*;/* ’.«■«(*  ).i*  ,•» )  (4-3) 

for  each  positive  k  such  that  tk  <tk>  whenever  k  <k'.  A  cumulative  measurement 
set  up  to  k  is  defined  as 

•/<*'  =  (U{1 . Nu(k')}X{k‘}  (4.4) 

For  the  sake  of  simplicity,  we  assume  that  possible  origins  of  measurements 
in  any  data  set  are  only  level-0  targets.  Let  IT  be  the  set  of  level-0  target 
indices.  For  each  data  set  k  ,  we  assume  an  assignment  function  Ak  defined  on  a 


subset  of  the  level-0  target  index  set  IT  taking  values  in  J{k)  =  (k )}. 

When  j  =Ak  (i,_lf 0),  we  say  level-0  target  (i,_v  .  .  . ,  i0)  is  detected  by  sen0'': 
sk  at  time  t and  generates  the  j -th  measurement,  or  the  j -th  measurement  ori¬ 
ginates  from  level-0  target  .  .  .  ,  i0).  With  the  no-split /no-merged  measure¬ 
ment  assumption,  such  an  Ak  is  a  well-defined  one-to-one  function.  Then,  given 
a  cumulative  data  set,  we  can  define  the  trace  of  a  level-/'  target  in  it  in  the  form 
of  a  subset  of  the  cumulative  measurement  index  or  a  collection  of  such  subsets 
at  the  given  level.  We  call  any  possible  realization  of  such  a  trace  a  level-l' 
track.  Thus  a  subset  of  the  measurement  index  set  is  a  level-0  track  if  it  contains 
at  most  one  measurement  index  set  for  each  data  set.  A  level-/'  track  is  a  collec¬ 
tion  of  nonoverlapping  level-(/'-l)  tracks.  A  level-l1  hypothesis  is  then  a  collec¬ 
tion  of  nonoverlapping  nonempty  level-/'  tracks  and  hypothesizes  all  the  set  of 
measurements  originating  from  level-/'  targets.  According  to  this  definition,  a 
level-l  track  is  also  a  level-0  hypothesis,  and  vice  versa,  although  its  interpreta¬ 
tion  as  a  track  is  completely  different  from  that  as  a  hypothesis. 

Multi-level  hypotheses  defined  above  may  be  illustrated  in  Figure  4-5  in 
which  /=3  and  a  level-2  hypothesis  is  represented  by  a  tree  depicted  by  solid 
lines.  In  Figure  4-5,  the  level-2  hypothesis  consists  of  two  level-2  tracks  each  of 
which  hypothesizes  a  group  of  detected  groups  of  targets,  {{r1,r2},{r3,r4}t 
{{r5},{r9,r7}},  where  r,  to  r7  are  level-0  tracks  each  of  which  hypothesize-  a. 
detected  level-0  target.  Given  such  a  hypothesis,  we  must  further  hypothes.ze 
the  existence  of  undetected  targets  and  the  overall  structure,  as  shown  in  Figure 
4-5  by  broken  lines.  The  process  to  group  given  level-0  tracks  r{  to  r7  in  a  level-0 
hypothesis  into  a  level-l  hypothesis  and  then  into  a  level-2  hypothesis  can  be 
viewed  as  a  bottom-up  procedure.  While  the  process  to  add  hidden  targets  and  to 
complete  the  overall  structure  can  be  viewed  as  a  top-down  procedure.  The 
evaluation  of  hypotheses  may  not  be,  however,  decomposed  in  such  a  manner. 
The  discussion  of  hypothesis  evaluation  in  a  general  level-/  case  may  be  very 
complicated.  Therefore,  in  the  following  sections,  we  will  restrict  ourselves  to  the 
cases  where  1=2,  i.e.,  where  tracking  of  multiple  groups  of  targets  is  concerned. 

Remark:  In  the  above  discussion,  we  only  considered  the  cases  where  each 
measurement  from  each  sensor  is  based  on  a  level-0  target.  The  definitions  of 
tracks  and  the  hypotheses  may  be  altered  so  that  measurements  from  different 
levels  may  be  treated.  At  this  moment,  however,  the  exact  form  of  the  appropri¬ 
ate  modification  is  not  very  clear. 


4.2  EVALUATION  OF  TWO-LEVEL  HYPOTHESES 

In  this  .subsection,  we  will  extend  our  general  theory  of  multitarget  tracking 
from  single-level  cases  to  two-level  cases,  i.e.,  tracking  multiple  groups  of  targets. 
The  issues  pertaining  to  implementation  will  be  briefly  discussed  in  terms  of  an 
example. 

4.2.1  Two-Le-*  Multitarget  Tracking 

When  the  target  structure  level  is  two,  i.e.,  I  =2,  the  overall  target  state 
can  be  written  as 

x  =(Na,  xQ,xlf . ,xN(.)  (4.5) 

where  NG  is  the  total  number  of  groups,  x0  is  the  state  component  common  to 
all  the  groups,  and  each  x,  is  the  i  -th  group’s  individual  state.  Each  x,  is  there¬ 
fore  in  form  of 

x,  ={Ni,xi0,xiu . ,xiN.)  (4.6) 

where  iV,  is  the  number  of  (level-0)  targets  in  group  i ,  xiQ  is  the  state  component 

common  to  all  the  targets  in  ^roup  i ,  and  xtJ-  is  the  individual  states  of  the  j-th 

target  in  group  » .  Let  the  ievel-1  target  index  set  be  IG  ={l,....,iVG  }  and  the 

No 

level-0  track  index  set  be  U  {« }X{1,.-.V, }.  Then  the  trace  of  level-0  target 

1=1 

(i  !,!„),  \.e.,  the  i0-th  target  in  the  yth  group,  in  a  cumulative  data  set  up  to  k  is 


TkW(iui 0)  =  {(>,*')  |  j=Ak,(il,i0),l<k'<k}  .  (4.7) 

The  trace  of  level-1  target  il  is  then 

3-*|1)(M)  =  {rl|0)(i..io)U<<.<^,}  •  (I-8) 

Then  a  level-0  hypothesis  is  a  possible  realization  of 

Ai°>  =  {TkW(ilti0)  |  r*(0)(i1,«o)^.(«'i.«'o)€/r  }  (4-9) 

and  a  level-1  hypothesis  is  a  possible  realization  of 

Ai1)  =  {Tk^(il)  I  .'!€/<?}  .  (4.10) 


We  can  extend  the  concept  of  tar gct-to -track  hypothesis  from  single-level  tracking 
to  two-level  tracking  as  follows:  A  level- 1  target-to-track  hypothesis  is  a  possible 
realization  of  a  one-to-one  random  function  from  to  IG  defined  by 


nfW'v'))  =  i 


(4.11) 


and  a  level-0  target-to-track  hypothesis  is  a  possible  realization  of  a  one-to-one 
function  from  to  }  (given  Tk^\i))  defined  by 


fi»l0Wo)(i1,;0);r, «(,-,))  =  i, 


(4.12) 


As  in  the  theory  of  single-level  multitarget  tracking,  whenever  we  must  distin¬ 
guish  a  realization  of  A^  from  that  of  we  call  the  former  data- to- data 

hypothesis. 


4.2.2  General  Results 


We  will  derive  a  recursive  formula  for  calculating  each  level-1  hypothesis. 
The  results  are  an  extension  of  the  single-level  tracking  results.  For  the  rest  of 
this  section,  we  make  the  standard  set  of  assumptions:  (l)  Targets  are  inter¬ 
changeable  a  priori.  (2)  The  data  sets  are  conditionally  independent  given  the 
target  states.  (3)  The  assignment  functions  are  totally  random.  The  first  step  is 
a  straightforward  recursive  formula 


1  i  *'*  ’)  =  (A‘"-‘ 1  •  (4-13> 


The  numerator  on  the  RHS  of  (4.13)  can  be  expanded  in  a  way  similar  to  that 
used  for  the  single-level  tracking  (as  described  in  [l]  and  [2])  and  yields 


/>  (A, 


PIAfil*1*-11) 


P(Z<*)|  Z^) 


(4.14) 


£  P(Na  I  A^.zf*-1)) 

Na  =#  (Ai1*)  (Na  — #  (A*«))! 


£  I1  Jm"1'''1,1  p(N°  \nc  .ni-W-U1*  -1’)  (*  (‘ )  I  *k  a  ■1)) 

reAj1)  (AT n4(l)(r)-#  (r))! 


where 


Na  =  (Na,Nl . JV„  ) 


(4.15) 


(*  (*  )A  ,Na  |  Z<‘  -«)  = 


(4.16) 
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J>  ((», ,  (*  »&“ 1  I  A.  ,JV„ (i  ),.  ( lk  ),NC  )  Pu (AT*  (t )  I  /„  (*  ),x  ( <4  ),JV ' 0  ) 
"  P(/i,T(t)l«((*).w0)P(Ji((l)|ivsA(Vl*'1,.n*|1-)i)  . 

The  updating  formulae  for  P(dx(tk)  |  Na 

P(Na  |  Na  ,n*^,A jl\z(k))  and  P  (NG  |  A !l\Z^k^)  can  be  derived  in  a  similar  way. 


4.2.3  I.I.D.-Poisaon  Groups 

In  single-level  tracking,  an  appropriate  set  of  independence  assumptions 
enables  us  to  reduce  a  general  form  into  a  more  implementable  form.  We  will 
repeat  such  a  process  for  two-level  multitarget  tracking.  The  additional  assump¬ 
tions  are  as  follows: 


[1]  Given  the  number  NG  of  groups,  the  group  states  tuple  (x,  )1=fj  is  a  system  of 
independent  Markov  processes  which  share  common  joint  probabilities. 
Thus  the  state  component  x0  common  to  all  the  groups  is  ignored.  The 
number  NG  of  groups  has  a  Poisson  distribution  with  mean  i/0. 

N 

[2]  Each  x,  =(x,  0,x,1,....,x,Ari),  given  N( ,  is  a  stochastic  process  such  that  (x,y ) J  =Lj 
is  a  system  of  interchangeable  Markov  processes. 


[3]  The  detection  is  target-wise  independent,  i.e.,  the  detection  of  target  (i1,«0) 
depends  only  (*,-  0,x,-  and  we  have 


n  pc (*..0.*.-,.-.  i  * }st,i,,«>(i  -  Pciv,1,,,,  i  * i)1  * 

(•  i.*  o)€/r 


(4.17) 


with  a  common  detection  probability  function  pD  . 

4]  Measurement  errors  are  also  target-wise  independent,  i.e.,  the  value  of  a 
measurement  originating  from  a  target  ( i  x,*  0)  is  correlated  only  to  (x,i0,xlilt). 
The  number  of  false  alarms  and  their  values  are  independent  of  the  targets 
and  from  data  set  to  data  set.  Thus  we  have 
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P (JV« (t )  |  Idt (*  ),I  (!« ),AT=  )  =  PnJNu (t  )-#  (fDT (*))!*)  (4.18) 


md  - 

P  ((»,■  (*  M/i." 1 1  A,  ,AT«  (1  ),*  (I,  ),W 1 0  )  =  (4.19) 


1  1  >'*  <Si  (* 1 1  ‘  )} 


with  a  number- of- false- alarm  probability  function  PNfA,  &  tar  get- state -to- 
measurement  transition  probability  density  function  p^ ,  and  a  false-alarm- 
value  probability  density  function  pFA  . 


Under  these  assumptions,  we  can  derive  results  which  are  very  analogous  to 
;  in  single-level  tracking  (described  in  [l]  and  [2])  and  are  summarized  as  fol- 
:  (l)  Given  a  level-1  target-to-track  hypothesis,  the  posterior  distributions  of 

group  states  (i, ),  are  independent,  (2)  the  posterior  distribution  of 
:tected  groups  becomes  Poisson,  and  (3)  the  hypothesis  evaluation  can  be 
ced  to  the  evaluation  of  level- 1  track- to- measurement  likelihood  as 


p(a,w  |z'*>)  = 


Pli-i  I  ^l>'1>)  expK-n-i) 

P(Z{k)  I  Z(*-1))  Nu{k)\ 

Wa  n  i  (*  {r  I  *  )|  Z  [*-'> ) 


(4.20) 


re  Lfa  is  the  false  alarm  likelihood, 

»  {>■  I  *>  =  {»/(*)!(>.*  )eUr}  (4.21) 

le  set  of  measurements  assigned  to  level-1  track  r  and  L(*|  Z  f*  )  is  the 
l-l  track-to-measurement  likelihood.  The  forms  of  the  above  likelihood  func- 
3  are  very  similar  to  that  of  the  hypothesis  evaluation  formula  for  the  single- 
1  tracking  of  dependent  targets. 


4  An  Example 

A  straight  forward  extension  of  single-level  tracking  to  two-level  tracking  is 
lible  using  the  results  shown  in  the  previous  two  subsections.  In  two-level 
king,  however,  the  combinatorial  problem  is  even  more  severe,  which  may 
:e  a  straightforward  extension  of  single-level  trackers  infeasible  in  many 


applications.  For  this  reason,  we  may  have  to  develop  new  techniques  for  over¬ 
coming  the  additional  combinatorial  burden  inherent  to  two-level  tracking.  In 
this  subsection,  we  will  discuss  this  aspect  of  the  problem  in  terms  of  a  simple 
example. 


We  consider  tracking  of  groups  of  ground  vehicles  moving  on  a  road  net¬ 
work.  By  a  two-step  transformations  to  take  care  of  (1)  the  route  selection  by 
each  group  and  (2)  the  curvature  of  each  road  segment,  the  problem  can  be 
reduced  to  that  of  tracking  groups  of  targets  moving  on  a  straight  line.  Let  u,  be 
the  1-dimensional  position  of  the  lead  vehicle  of  the  »-th  group  and  v,  be  its 
velocity.  Then  the  position  and  the  velocity  of  the  j-th  vehicle  in  group  i  can 
be  modeled  as 


and 


=  «,  -  (j-l)c,  +  (ij 


(4.22) 


=  *,  + 


(4.23) 


where  e,  v \  is  the  expected  distance  between  two  vehicles  in  group  i ,  £tJ  and  r;tJ 
represent  randomness  in  position  and  velocity  of  each  vehicle  in  the  group.  We 
assume  that  the  randomness  can  be  modeled  by  independent  gaussian  random 
variables.  The  group  dynamics  are  then  assumed  to  be  a  simple  almost  constant 
velocity  model  with  an  appropriate  white  gaussian  driving  noise.  Thus  we  may 
have  a  very  simple  target  model  in  which  the  state  component  common  to  all  the 
targets  in  group  «  is 

*<o  =  («..*>.. °i)  (4-24) 

where  is  a  discrete  variable  representing  the  type  of  group  * .  The  individual 
target  state  of  the  j  -th  target  in  group  i  is  then  simply  its  type  atj . 

For  each  possible  type  of  group,  we  assume  that  we  have  a  sufficient 
number  of  templates  of  the  group  including  composition  of  different  types  of  vehi¬ 
cles  and  their  order  when  moving  on  the  road.  Each  template  can  be  represented 
by 

e  =  (a  ,W, 6  (4.25) 

where  a  is  the  type  of  a  group,  N  is  the  number  of  vehicles  in  the  group  and  6, 
is  the  type  of  the  i  -th  vehicle  in  the  group.  Therefore  the  level-1  track  distribu¬ 
tion,  i.e.,  the  group  state  distribution,  is  a  distribution  on  (~oo,oo)2x£,  where  E 


is  the  set  of  all  the  templates.  In  general,  we  may  assume  at  least  in  an  approxi¬ 
mated  sense  the  independence  of  motion  from  the  type  component  as 
P  (du  ,dv  ,de  )=P  (du  ,dv  )P  (de  ). 

When  a  data  set  is  received  from  a  sensor,  each  group  hypothesis  is  given  a 
set  of  measurements  which  may  be  associated  to  it.  Then  the  set  of  measure¬ 
ments  is  ordered  linearly  and,  for  each  template,  the  level-1  track-to- 
measurement  likelihood  is  calculated  after  template-to- measurement  matching  as 
shown  in  Figure  4-6.  In  such  a  process,  we  must  use  a  very  effective  method  for 
determining  a  likely  level- 1  track-to-measurement  assignment.  For  example,  for 
each  template,  we  first  estimate  the  most  probable  distance  between  targets 
based  on  the  velocity  estimate  and  then  spread  the  vehicles  in  the  template 
accordingly.  Then,  by  an  effective  assignment  algorithm,  we  can  find  a  feasible 
assignment  between  the  given  set  of  measurements  and  the  vehicles  in  the  tem¬ 
plate.  After  determining  the  assingment,  we  can  calculate  the  level-1  track-to- 
measurement  likelihood. 

4.2.5  Distributed  Hypothesis  Formation  and  Evaluation 

As  shown  earlier  in  this  report,  distributed  hypothesis  formation  is  a  pro¬ 
cess  of  creating  a  logically  consistent  set  of  hypotheses  from  a  collection  of  local 
sets  of  hypotheses.  This  process  amounts  to  the  consistency  checking  on  the 
overlapped  pieces  of  information  in  the  past.  It  is  also  determined  purely  by  the 
definitions  of  tracks  and  hypotheses  and  independent  of  their  probabilistic 
nature.  Therefore  it  is  expected  that  we  may  extend  the  single-level  tracking 
results  to  the  two-level  or  in  general  level-/  tracking  cases.  The  results  may  be  a 
similar  type  of  consistency  checking  on  the  predecessors  of  tracks  and  hypotheses. 
However,  although  the  final  results  are  fairly  simple  in  single-level  tracking  cases, 
complicated  steps  were  necessary  to  derive  implementable  results.  It  is  hence 
expected  that  the  logical  arguments  involved  in  two-level  tracks  and  hypotheses 
may  well  be  very  complicated. 

On  the  other  hand,  distributed  hypothesis  evaluation  involves  the  distri¬ 
buted  estimation  and  is  highly  dependent  on  the  structure  of  the  global 
hypothesis  evaluation  formula.  In  the  single-level  tracking  cases  (with  the  i.i.d. 
Poisson  assumption),  the  hypothesis  evaluation  equation  is,  in  essence,  a  product 
of  track  likelihoods  and  each  track  likelihood  is  an  integration  of  a  product  of 
state-to-measurement  transition  probability  densities.  Thus  each  track  likelihood 
can  be  decomposed  using  distributed  estimation  theory.  In  two-level  tracking 
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Figure  4-6:  Template-to-Measurement  Matching 
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cases,  however,  the  level-1  track- to- measurement  likelihood  involves  summation 
over  many  possible  numbers  of  targets  in  each  group,  which  may  cause  difficulty 
in  decomposing  the  track  likelihood  into  the  independent  components.  We  may 
well  need  a  kind  of  aggregation  of  tracks  and  hypotheses  in  order  to  produce  a 
workable  algorithm  for  distributed  hypothesis  evaluation  for  the  two-level  track¬ 
ing.  The  dynamic  behavior  of  groups  may  also  complicate  the  discussions. 


4.3  CONCLUSION 


A  first-cut  analysis  on  multitarget  tracking  concerning  a  structured  set  of 
targets  has  been  discussed  in  this  section.  The  discussions  in  this  section  are 
summarized  as  follows:  (1)  Structured  sets  of  targets  may  be  treated  in  an 
integrated  form  and  concepts  of  tracks  and  hypotheses  can  be  extended  from  the 
single-level  cases  in  a  straightforward  way.  (2)  Two-level  multitarget  tracking 
hypothesis  evaluation  can  be  done  by  extending  the  single-level  tracking  results. 
(3)  Practical  methods  for  implementing  two-level  hypothesis  evaluation  needs 
however  further  investigation.  (4)  Distributed  hypothesis  formation  and  evalua¬ 
tion  for  two-level  tracks  and  hypotheses  may  be  possible  by  extending  the  single- 
level  results  but  we  need  more  time  to  clear  this  problem.  The  future  efforts  per¬ 
taining  to  the  topics  covered  in  this  section  may  include:  (1)  effective  implemen¬ 
tation  of  single-level  tracking  with  correlation  among  targets,  (2)  implementation 
of  two-level  multitarget  tracking  algorithms,  and  (3)  development  of  distributed 


level-1  hypothesis  formation/evaluation  algorithms. 
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6.  ACOUSTIC  TRACKING  EXPERIMENTS  AND  ALGORITHMS 


As  part  of  the  DARPA  DSN  program,  M.  I.  T.  Lincoln  Lab.  has  performed 
research  on  the  tracking  of  low  flying  aircraft  using  acoustic  sensors.  A  DSN  test 
bea  has  been  developed  and  used  to  test  and  demonstrate  DSN  techniques  and 
technology.  This  section  describes  how  the  general  distributed  tracking  algo¬ 
rithms  developed  at  ADS  can  be  applied  to  the  acoustic  tracking  scenarios  used 
by  Lincoln  Lab.  We  first  present  some  candidate  experiment  scenarios.  Then  we 
discuss  the  development  of  acoustic  tracking  algorithms  based  on  the  multiple 
hypothesis  approach. 

5.1  ACOUSTIC  TRACKING  EXPERIMENTS 

This  section  describes  the  kind  of  DSN  systems  and  scenarios  for  which  new 
distributed  acoustic  tracking  algorithms  are  to  be  developed  and  evaluated.  It 
describes  a  family  of  systems  and  scenarios  that  will  result  in  a  range  of  tracking 
problems;  from  easy  to  quite  difficult.  The  system  and  scenarios  are  essentially 
those  which  Lincoln  had  considered  in  a  more  informal  way  during  its  earlier 
algorithm  development  effort  and  which  have  been  used  as  the  basis  for  the 
evaluation  of  existing  Lincoln  algorithms.  Much  of  the  information  in  this  sec¬ 
tion  has  been  provided  by  Lincoln  Lab. 

The  system  follows  that  of  the  Lincoln  test  bed  and  is  a  multiple  node 
acoustic  system  for  low  flying  aircraft  surveillance.  The  sensors  at  each  node  are 
small  acoustic  arrays  that  provide  lists  of  possible  target  detections  along  with 
azimuth,  accuracy  and  power  level  estimates  every  few  seconds.  The  scenarios 
range  from  single  aircraft  with  straight  flight  paths  operating  under  low  back¬ 
ground  noise  conditions  to  more  difficult  scenarios  involving  several  maneuvering 
aircraft.  Basic  communication  service  consists  of  an  unacknowledged  radio 
broadcast  service  in  which  nodes  can  receive  broadcasts  only  from  a  limited  set  of 
neighbors. 


5.1.1  Acoustic  Sensors 

The  acoustic  sensors  in  the  DSN  test  bed  are  small  microphone  arrays 
which  detect  possible  targets,  measure  acoustic  azimuths  and  provide  signal-to- 
noise  estimates  that  can  be  used  to  ascribe  accuracy  values  to  the  azimuth 


measurements.  Measurements  are  nominally  made  every  two  seconds  and  the 
measurement  (after  signal  processing)  corresponds  to  an  average  target  azimuth 
over  a  two  second  interval.  The  sensors  provide  no  target  elevation  information. 
The  development  of  tracking  algorithms  will  emphasize  acoustic  arrays  with 
capabilities  comparable  to  those  that  Lincoln  had  been  using,  with  at  most  a  lim¬ 
ited  consideration  of  arrays  with  different  performance  characteristics. 

The  azimuth  accuracy  of  the  acoustic  arrays  is  on  the  order  of  two  degrees 
and,  depending  upon  target  type  and  background  noise  conditions,  the  detection 
range  for  a  single  target  is  from  a  few  to  a  few  tens  of  kilometers.  A  good  nomi¬ 
nal  value  to  use  is  five  kilometers.  Target  detection  probability  and  azimuth 
accuracy  depend  upon  signal  to  noise  ratio.  For  a  given  signal  source  strength 
the  signal-to-noise  ratio  depends  upon  range  although  it  is  also  influenced  by 
topography  and  propagation  conditions.  Detection  probability  will  be  low  at  long 
range  and  increase  as  the  target  comes  closer  to  the  sensor.  Topographic  features 
such  as  hills  may  introduce  quiet  zones  within  which  this  increase  of  signal  level 
with  decreasing  range  does  not  hold. 

The  number  of  targets  within  the  detection  range  of  a  sensor  that  can  be 
simultaneously  detected  and  isolated  in  azimuth  depends  upon  many  factors. 
These  include  array  aperture,  number  of  sensors  in  each  array,  noise  level,  signal 
level  and  the  azimuthal  separation  of  the  targets.  For  existing  DSN  arrays  and 
signal  processing  algorithms  the  number  of  targets  that  can  be  simultaneously 
isolated  is  on  the  order  of  three  to  five,  assuming  they  are  sufficiently  separated 
in  azimuth  and  do  not  have  excessively  disparate  power  levels.  A  nominal  value 
for  the  required  azimuthal  separation  for  targets  with  roughly  equal  power  is  20 
degrees. 

The  number  of  targets  that  can  be  isolated  by  a  single  acoustic  sensor  lim¬ 
its  the  local  target  density  for  target  tracking  but  does  not  limit  the  total  number 
of  targets  for  the  entire  system.  For  a  fixed  spatial  density  of  DSN  nodes  the 
number  of  targets  that  can  be  individually  tracked  will  scale  up  linearly  with  the 
geographic  area  of  the  network.  In  addition,  clusters  of  unresolved  targets  can  be 
tracked  if  not  isolated  from  each  other. 

In  the  absence  of  targets,  the  number  of  false  detections  generated  by  the 
sensor  and  its  associated  signal  processing  algorithms  is  on  the  order  of  three  to 
five  for  each  measurement  interval. 


Measurement  intervals  other  than  two  seconds  might  be  used  to  improve 
azimuth  measurement  accuracy  for  fast-moving  nearby  targets  or  to  improve 
accuracy  and  detectability  for  very  distant  targets.  If  this  is  a  controllable  vari¬ 
able,  it  may  used  for  tracking  maneuvering  targets.  Also,  the  sampling  rate  may 
be  decreased  when  the  tracking  performance  is  adequate  or  when  the  algorithm 
cannot  keep  up  with  the  arrival  of  the  measurements. 

A  lower  limit  to  azimuth  accuracy  is  imposed  by  propagation  physics,  not 
by  acoustic  array  size  or  processing  techniques.  A  reasonable  value  for  this  lower 
limit  is  probably  about  one  degree.  Azimuth  errors  larger  than  a  few  degrees 
might  be  obtained  from  arrays  that  are  smaller  than  the  five  meter  arrays  used 
by  Lincoln  or  for  signals  with  only  very  low  frequency  signal  content.  Errors  of 
more  than  about  ten  degrees  p:obably  should  not  be  considered  unless  very  poor 
location  accuracy  is  acceptable.  In  general,  we  will  be  concerned  with  systems 
which  can  locate  aircraft  to  within  a  kilometer  or  less  in  the  horizontal  plane. 

Specific  and  detailed  statistical  sensor  models  will  be  formulated  and  refined 
as  needed  to  support  the  development  of  tracking  algorithms. 

6.1.2  System  Deployment 

There  are  two  primary  DSN  deployment  options:  barrier  and  area.  The 
barrier  concept  is  to  deploy  a  thin  DSN  ever  a  long  linear  extent  and  is  appropri¬ 
ate  for  early  warning  situations.  In  D  is  case,  the  primary  interest  is  in  target 
acquioiiior  and  transient  ohnnomena  as  the  targets  approach  and  pass  through 
the  barrier.  Area  deployment  is  needed  to  provide  continuous  surveillance  over 
large  areas  and  steady-state  performance  for  targets  internal  to  the  network  is  a 
more  important  issue.  Both  transient  and  steady-state  performance  issues  come 
together  in  the  outer  layers  of  an  area  DSN  or  in  a  barrier  system  with  more  than 
one  layer  of  thickness.  Transient  behavior  will  dominate  as  targets  approach  the 
outer  layer  of  nodes  and  steady-state  behavior  should  dominate  by  the  time  the 
second  or  third  layer  is  reached.  The  DSN  systems  of  interest  contain  many 
nodes  but  it  should  be  possible  to  investigate  and  test  algorithms  with  from  two 
to  six  node  configurations. 

Examples  of  barrier  and  area  DSN  systems  are  shown  in  Figure  5-1.  The 
deployment  shown  in  the  figure  is  on  a  regular  grid  but  in  general  deployments 
will  be  more  randomized  and  algorithms  should  be  designed  with  that  in  mind. 
Depending  upon  the  specific  system  and  deployment,  the  number  of  nearest 
neighbors  at  about  the  same  distance  will  range  from  two  to  six. 
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Figure  5-1:  DSN  Deployment  Configuration 
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Sensor  detection  range,  distances  between  nodes,  and  the  broadcast  com¬ 
munication  range  are  very  important  DSN  network  parameters.  Lincoln  tracking 
algorithms  have  been  developed  for  the  case  when  the  sensor  range  and  the  dis¬ 
tance  between  sensors  are  about  equal  and  the  nominal  broadcast  range  is  twice 
the  distance  between  sensors.  This  situation  appears  to  be  optimal.  For  smaller 
broadcast  ranges,  the  nodes  will  become  information  poor  unless  additional  com¬ 
munication  mechanisms  are  added  to  distribute  information  to  more  remote 
nodes.  For  smaller  sensor  ranges,  the  nodes  become  information  poor  but  the 
problem  is  more  fundamental  since  that  lack  of  information  is  because  not 
enough  sensors  detect  each  target  at  the  same  time.  The  new  algorithms  should 
also  emphasize  the  nominal  case  but  may  offer  performance  improvement  possi¬ 
bilities  under  one  or  both  of  the  information  poor  situations. 


6.1.3  Internodal  Communication 

The  nominal  internodal  communication  is  a  limited  range  unacknowledged 
broadcast.  Ideally  a  broadcast  is  received  without  error  by  all  nodes  within 
ange.  The  nominal  broadcast  area  is  a  circle  defined  by  the  broadcast  range. 

Algorithms  must  also  operate  under  other  than  idealized  situations.  There 
may  be  ‘;dead  areas”  within  the  nominal  broadcast  disks.  Those  dead  areas  may 
be  known  and  accounted  for  by  tracking  algorithms.  They  may  be  unknown  and 
the  algorithms  should  be  designed  to  be  robust  in  their  presence  if  possible. 

Communications  may  also  be  subject  to  errors  in  the  form  of  lost  messages. 
Algorithm  development  should  consider  how  to  treat  randomly  lost  broadcast 
messages.  Note  that  the  messages  will  be  lost  upon  reception,  not  broadcast,  so 
that  a  message  may  be  correctly  received  by  any  number  of  nodes  within  broad¬ 
cast  range.  The  system  should  be  designed  to  handle  at  least  a  few  percent  of 
lost  messages.  In  general  the  performance  may  degrade  with  increasing  percen¬ 
tages  of  lost  messages,  but  the  system  should  not  catastrophically  fail. 


6.1.4  Target  Scenarios 


The  number  of  possible  target  scenarios  is  very  large.  The  seen?  .  to  be 
used  in  the  experiments  will  be  selected  based  upon  Lincoln  s  past  experience 
with  trackers  and  our  best  judgement  concerning  interesting  or  critical  situations. 
To  be  consistent  with  the  Lincoln  scenarios,  we  will  assume  the  targets  to  be  low 
flying  at  about  500  meters  above  ground  level. 
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The  scenarios  are  described  in  terms  of  the  local  density  of  targets.  One, 
two,  and  three  target  situations  are  emphasized.  Satisfactory  local  performance 
for  resolved  and  unresolved  targets  will  translate  directly  into  satisfactory  perfor¬ 
mance  for  many  more  targets  and  clusters  of  targets  in  a  large  DSN  system. 

Initially  we  will  consider  single  target  scenarios.  This  is  primarily  for  test¬ 
ing  the  basic  algorithms  and  the  communication  between  nodes.  Both  maneuver¬ 
ing  and  non-maneuvering  situations  should  be  considered.  Maneuvers  include 
changes  of  speed  and  direction.  For  non-maneuvering  targets,  we  should  consider 
both  direct  and  angled  approaches  to  the  DSN  boundary  and  with  targets  passing 
very  near  to  nodes  as  well  as  between  nodes.  At  least  some  consideration  should 
be  given  to  high  speed  (Mach  0.9)  cases  to  be  certain  that  there  is  no  unexpected 
behavior.  The  case  of  Mach  0.6  is  probably  more  typical  of  low  flying  aircraft  or 
long  range  cruise  missiles.  Mach  0.1  is  representative  of  a  very  slow  target  such 
as  a  helicopter. 

Since  our  algorithms  are  supposed  to  handle  multiple  targets  effectively,  we 
will  consider  two-target  scenarios  of  varying  complexity.  We  will  use  a  set  of 
two-target  scenarios  covering  three  distinct  target  configurations.  These  are  the 
in-line  formation  in  which  the  two  targets  follow  one  behind  the  other,  the  paral¬ 
lel  formation  in  which  they  follow  parallel  tracks  and  the  crossing  formation  in 
which  their  tracks  cross.  In  most  cases,  the  targets  will  have  the  same  speeds  but 
some  situations  with  targets  at  two  different  speeds  are  included  since  a  fast  tar¬ 
get  overtaking  a  slow  one  may  cause  some  problems  for  tracking  algorithms.  The 
crossing  scenario  will  be  most  stressing  when  targets  reach  the  crossing  point  (at 
different  altitudes)  at  the  same  time. 

One  and  two  target  scenarios  may  not  adequately  stress  track  initiation  and 
data  association  algorithms  although  they  should  be  adequate  for  most  other  pur¬ 
poses.  Thus  we  wili  experiment  with  a  few  additional  three-target  scenarios  that 
will  provide  additional  stress. 

6.1.6  Measures  for  Performance  Evaluation 

In  this  section,  we  discuss  suitable  measures  for  evaluating  the  performance 
of  distributed  acoustic  tracking  algorithms.  The  evaluation  is  complicated  by  the 
presence  of  multiple  nodes,  multiple  targets,  and  multiple  hypotheses  since  at  any 
particular  time,  the  tracking  performance  depends  on  the  node,  the  hypothesis, 
and  the  target  of  interest.  In  addition  to  local  measures,  more  aggregate  meas¬ 
ures  for  the  entire  system  are  also  desirable.  The  system  performance  also 


see 


ends  on  the  sensor  and  target  characteristics  in  addition  to  the  system 
figuration.  Contributions  to  the  performance  from  these  parameters  should  be 
ated  for  a  fair  evaluation  of  the  algorithm  performance. 

.5.1  Evaluation  of  Tracking  performance 

We  first  discuss  measures  which  evaluate  how  well  the  algorithms  track, 
ce  a  multiple  hypothesis  approach  is  used,  the  tracking  performance  can  be 
ided  into  two  levels:  hypothesis  level  and  track  level.  These  will  be  discussed 
arately  in  the  following: 


Hypothesis-level  measures  include  the  number  of  false  targets  and  the  number 
of  missed  targets.  A  hypothesis  is  a  collection  of  tracks.  Using  appropriate 
thresholds,  the  tracks  can  be  identified  with  the  actual  targets  in  the  scenario. 
The  missed  taraets  and  the  false  tracks  can  thus  be  enumerated.  This  can  be 
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system.  As  discussed  before,  the  sensor  and  target  characteristics  are  also  impor¬ 
tant  variables  affecting  the  system  performance.  If  poor  sensors  are  used  with  a 
difficult  target  scenario,  then  the  performance  of  the  system  would  be  expected  to 
be  poor  inspite  of  a  good  algorithm.  Thus  a  reference  should  be  used  in  evaluat¬ 
ing  algorithm  performance.  A  suitable  reference  is  the  performance  of  the  cen¬ 
tralized  algorithm  and  that  of  distributed  algorithm  can  be  compared  with  it. 

5. 1.6. 2  Cost  measures 

The  cost  measures  reflect  the  amount  of  resources  used  to  produce  the 
measured  performance.  Relevant  resources  include  the  local  computation  time, 
the  memory  size  and  the  amount  of  communication.  The  effectiveness  of  a  pro¬ 
cessing  node  or  the  total  system  can  be  measured  by  the  amount  of  resource  it 
needs  to  produce  a  fixed  level  of  performance.  When  there  is  a  constraint  on  the 
resource,  a  good  system  is  one  which  uses  the  resources  to  produce  the  best  per¬ 
formance. 

In  a  simulation  of  the  DSN,  ways  should  be  devised  to  measure  the  resource 
utilization,  e.g.,  the  computation  time,  the  memory  size  profile,  the  amount  of 
communication,  etc.  The  computation  time  required  may  be  recorded  by  means 
of  a  system  clock.  The  memory  size  can  be  expressed  in  bytes  or  in  terms  of  the 
number  of  hypotheses  or  tracks  stored  at  each  node.  The  amount  of  communica¬ 
tion  can  also  be  measured  in  various  ways.  These  quantities  can  be  expressed  for 
each  node  at  each  time,  or  for  each  node  over  an  interval.  From  these  system 
level  measures  can  be  computed. 

Such  data  may  provide  vital  information  on  possible  refinements  or 
improvements  of  the  various  modules.  If  necessary,  resource  allocation  modules 
may  be  developed  to  meet  the  hard  constraints  at  each  DSN  :ode.  For  example, 
a  way  for  the  processing  to  keep  up  with  the  arrival  of  data  is  by  skipping  sensor 
scans  when  the  processing  lacks  behind  arrival  of  data. 

All  the  measures  described  above  can  be  evaluated  using  simulated  or  real 
data.  Monte  Carlo  simulations  can  be  performed  when  the  data  are  synthetic. 
Statistics  on  the  various  measures  can  then  be  obtained. 


6.1.6  Data  Sources 


Real  and  simulated  acoustic  data  will  be  used  to  test  algorithm  components 
as  they  are  developed. 

Real  data  will  provide  stressing  clutter  situations  for  simple  scenarios  with 
only  a  few  nodes  and  with  poor  to  good  knowledge  of  ground  truth.  Data 
recorded  at  Lincoln  Laboratory  and  at  test  ranges  and  air  bases  in  the  Western 
U.S.  are  available. 

Many  scenario  variations  will  require  use  of  simulated  data.  That  data  will 
be  generated  using  a  previously  developed  acoustic  data  simulator  that  operates 
under  VAX/UNIX  developed  by  Lincoln  Lab.  Given  system  parameters  and  a 
description  of  the  target  scenario,  it  simulates  the  clutter  and  azimuth  measure¬ 
ment  outputs  from  the  nodal  signal  processing  subsystems.  Using  this  tool  we 
will,  under  very  controlled  conditions,  generate  algorithm  development  data  for 
situations  that  would  otherwise  be  very  difficult  to  obtain.  We  plan  to  imple¬ 
ment  this  data  generator  on  the  same  machine  as  the  algorithms  to  facilitate 
experimentation. 

6.2  ACOUSTIC  TRACKING  ALGORITHMS 

Although  the  general  methodology  developed  in  our  research  is  in  theory 
applicable  to  the  acoustic  tracking  problem,  the  acoustic  scenario  raises  technical 
issues  which  need  to  be  addressed  before  algorithms  can  be  developed  to  perform 
satisfactorily.  In  the  following  sections  we  discuss  these  issues  and  relevant 
models  and  how  the  general  algorithms  can  be  adapted  for  acoustic  tracking. 

6.2.1  Issues  and  Models  in  Acoustic  Tracking 

Some  special  features  of  acoustic  tracking  and  the  associated  technical 
issues  are: 

•  Azimuth-only  measurements.  Each  acoustic  sensor  measures  only  the  azimuth 
of  the  target.  Thus  from  a  single  node,  the  target  location  is  not  very  observ¬ 
able  from  the  azimuth  measurements.  From  a  pair  of  nodes,  however,  a  target 
becomes  more  observable.  An  important  question  is  thus  the  types  of  process¬ 
ing  to  be  performed  locally  by  one  node  and  jointly  by  a  pair  of  nodes.  One 
possibility  is  to  use  different  representations  such  as  azimuth  tracks  for  local 
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where  w  is  modeled  by  an  independent  zero-mean  gaussian  random  variable  (r.v.) 
whose  variance' is  yet  to  be  specified. 

Let  the  sound  pressure  at  the  1-meter  distance  from  the  target  be  s  0.  Then 
the  sound  pressure  measurement  sM  at  the  sensor  is 

=  G  (5-3) 

where  r  is  the  acoustic  range,  i.e.,  r  =c  6,  and  G  is  the  sensor  gain.  To  account 
for  irregular  propagation  and  other  random  factors,  either  additive  or  multiplica¬ 
tive  noise  should  be  added  to  (5.3).  The  sensor  also  measures  ambient  noise  s/V . 
Thus  when  the  measured  sound  pressure  exceeds  a  given  threshold  sTH  ,  the  sen¬ 
sor  generates  a  measurement  y  'SM  >sn)  consisting  of  the  acoustic  azimuth 

and  the  signal/noise  sound  pressure  levels. 

The  azimuth  measurement  error  standard  deviation  (SD)  a ^  (of  w  in  (5.2)) 
is  determined  by 


<7  A  = 


T(SNR  ) 


where 

-  6<j>  is  the  sensor  resolution  (about  20  degrees) 

-  SNR  =sM  /sff 

-  T(SNR  )=min{max{l,>/ SNR  },  10}. 

The  number  of  false  alarms  is  modeled  as  a  Poisson  random  variable  independent 
from  scan  to  scan.  The  delayed  azimuth  value  of  a  false  alarm  is  distributed  uni¬ 
formly  on  [0,27rJ  and  the  sound  pressure  value  has  an  exponential  distribution 
biased  by  the  threshold  value. 

When  two  acoustic  azimuth  measurements,  <j>h  and  <j>l are  close  enough, 


i.e.,  |  <i>M~<i>M  |  <6<l>,  they  are  merged  into  a  single  measurement.  The  merged 
acoustic  azimuth  measurement  is  modeled  as 


Each  target  state  distribution  (TSD)  consists  of  geolocational  TSD  (GTSD) 
component(s)  and  a  sound  pressure  TSD  (SPTSD)  component.  A  TSD  com¬ 
ponent  is  called  local  if  the  distribution  can  be  derived  from  the  measurements  of 
a  single  sensor;  otherwise  it  is  called  global.  Thus  a  GTSD  component  is  either 
global  or  local  while  a  SPTSD  component  is  always  local.  In  general  GTSD  or 
SPTSD  components  may  be  represented  as  sum-of-gaussians  (i.e.,  multiple  gaus- 
sian  terms  with  a  probabilistic  weight  attached  to  each  term).  A  track  may  have 
only  a  local  GTSD  component.  In  such  a  case,  a  track  is  said  to  be  local.  Or  a 
track  may  have  a  global  GTSD  component  or  both  global  and  local  GTSD  com¬ 
ponents.  Then  the  track  is  said  to  be  global.  Figure  5-4  shows  a  taxonomy  of  the 
target  state  distributions. 

A  local  GTSD  component  is  a  gaussian  distribution  on  the  (local)  acoustic 
azimuth  of  a  target  and  its  derivative,  and  possibly  higher-order 

derivative(s).  Local  GTSD  components  are  used  to  allow  each  sensor  to  initiate 
tracks  locally  from  acoustic  azimuth  measurements.  As  a  local  track  accumulates 
acoustic  azimuth  data,  the  acoustic  azimuth  rate  4>  is  estimated  with  increasing 
accuracy  as  indicated  by  the  decreasing  variance  matrix  in  the  local  GTSD  com¬ 
ponent  terms.  A  global  GTSD  component  term  is  a  gaussian  distribution  on  the 
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Figure  5-4:  Target  State  Distributions 


global  coordinates,  i.e.,  the  target  position  and  the  velocity  in  the  north-east 
coordinate,  and  possibly  their  higher-order  derivatives.  A  global  GTSD  com¬ 
ponent  term. is  formed  from  two  local  tracks  when  different  sensors  communicate. 

A  SPl'SD  component  tracks  the  change  in  the  measured  sound  pressure.  It 
serves  the  following  functions: 

•  to  provide  an  additional  discriminant  (particularly  from  false  alarms) 

•  to  predict  when  a  target  leaves  the  sensor  coverage 

•  to  predict  the  merged  acoustic  azimuth  measurement  when  measurement  merg¬ 
ing  fa  likely. 


This  component  is  also  used  to  estimate  the  targets’  noisiness.  A  SPTSD  com¬ 
ponent  term  is  a  gaussian  distribution  on  the  (fictitiously  noiseless)  received 
sound  pressure  s  and  its  derivative,  and  possibly  higher-order  derivative(s).  The 
actually  measured  sound  pressure  sM  is  modeled  by 

sM  =  s  +  w,  (5.8) 

where  the  artificial  noise  terra  wa  (modeled  by  independent  zero-mean  gaussian 
r.v.)  accounts  for  scan-to-scan  fluctuation  of  the  sound  pressure  measurements. 
It  may  be  argued  that  a  multiplicative  noise  term  is  more  appropriate.  In  such  a 
case,  (5.8)  remains  valid  ifter  taking  the  logarithm  of  each  variable. 


The  updating  of  each  a  SD  component  is  performed  simultaneously  with  the 
hypothesis  evaluation  (described  in  the  nev*  action).  O  the  other  hand,  the 
extrapolation  of  each  TSD  component  term  is  performed  with  the  help  of 
appropriate  target  dynamic  models,  i.e.,  constant-velocity  or  constant- 
acceleration  linear  models  with  an  \pp;op‘iale  white  noise  input.  For  example, 
in  order  to  update  a  local  GTSD  compe.'ent  >  -:u,  ma,  use  the  following  sim¬ 
ple  set  of  differential  equations: 


—  <j>  <j> 

dt9  9 


—  6  =  white  noise 
dt 


Since  the  acoustic  azimuth  dynamics  are  in  fact  nonlinear,  the  intensity  of  white 
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Figure  5-5:  Hypothesis  Expansion  with  Measurement  Merging  Possibility  (1) 
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5.2. 3. 2  Hypothesis  Evaluation 


u  fVlp  hypotheses  X  in  the  old  cluster  the  resultant  collec- 
After  expanding  all  the  hypoth  hypothesis  X  has  a 

tion  of  new  hypotheses  forms  on  updated  cluster. Ea  h  J  ^  x  gett. 

unique  parent  and  a  q  the  possibffity  of  measurements 

erated.  Then  evaluation  of  hypothes  ,  ,  hypothesis  evaluation 

merging,  can  be  done  by  replacing  by  A  tracks  merged 

formula  14'  and  probabilistically  assessing  the  joint  event 

formula  4  ,  an  p  summarized  as 

and  generating  a  single  measurement.  The 


Prob.  {\|  Z)  =  <r‘  Prob.  {X  |  2  } 


A 

(nit  (y  IT)!  u  W  and  T  is  assigned  measurement  y  }j 

(nit  (» I  (f,A»  I  and  r’ex  but  they  did  “ot  merge>-* 

(n{i  ((  I  r)  I  T€X  but  not  assigned  any  measurement,  i.e„  r=r})  (5.10) 


where 


is  the  cumulative  data  set  including  the  current  sensor  scan 


z  is  Z  minus  the  current  sensor  scan 


C  is  the  normalizing  constant 


is  the  symbol  used  to  represent  “no  measurement’ 


The  L  (•  1  •)’»  a-re  likelihood  functions  defined  below. 

T  ..  V^nnl\  (T  (u  I  0)).  When  T  is  0,  L  (y  |  0) 

Newly  Detected  Target  Likelihood  (L  (H«))  ^  undetected  before 
is  the  likelihood  of  measurement  y  origin  g 
and  is  given  by 

L  (y  |  0)  =  Pnt{4>m)!Pfa  5' 

.  .  m  is  the  expected  density  of  undetected  targets,  translated  into  the 

where  P„  ( )  s  P  ^  density  „f  the  false  alarms  over  the 

acoustic  azimuth  space,  i.e,  [tM*!-  PFA 

[0,2 7r]  interval,  i.e., 


i 


ft 


@FA  —uFA  /2?r 


(5.12) 


where  uFA  is  the  expected  number  of  false  alarms  (about  from  1  to  3)  per  scan. 
Equation  (5.11)  also  assumes  that  the  sound  pressure  measurement  distribution  of 
a  target  “heard”  (detected)  for  the  first  time  is  equal  to  that  of  a  false  alarm. 


Old  Track  Measurement  Likelihood  ( L  (y  |  T),  T^0)  When  T^0, 
L  (y  |  T)  is  the  likelihood  of  measurement  y  originating  from  an  existing  track 
T={7}  or  jointly  from  two  existing  tracks  T={71,r2}  and  is  defined  by 


L{y  I  T)  = 


^  i  T)  Ls  {sM  |  T) 
&FA  P,FA(sm) 


(5.13) 


where 


-  L  ,(*„  |  T)  is  the  azimuth  measurement  likelihood 

-  L3(sm  |  T)  is  the  sound  pressure  likelihood 

-  pfA  is  the  probability  density  of  the  false  alarm  sound  pressure. 


For  simplicity,  we  assume  that  the  GTSD  and  SPTSD  components  of  each  track 
are  both  single-termed.  There  are  two  different  cases. 


Case  1:  No  Merged  Measurement.  In  case  #  (T)=l,  i.e.,  when  there  is 
no  merging,  we  have 


£  I  {/})  — 


(5.14) 


with  (j)  being  the  acoustic  azimuth  prediction  by  a  local  or  global  GTSD  com¬ 
ponent  of  7  and  ~a£  being  the  corresponding  innovations  variance  given  by 

<7/  =  at(SNR  )!  +  5}  (5.15) 


where  <r^(-)  is  the  azimuth  measurement  error  standard  deviation  as  a  known 
function  of  signal-to-noise  ratio  SNR=s^/nnf,  and  is  the  expected  error 
variance  of  the  azimuth  estimate  by  track  r. 
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The  sound  pressure  likelihood  is  calculated  as 


(sm  I  fr})  — 


(5.16) 


where 


-  s  is  the  sound  pressure  measurement  predicted  by  the  track  r 

9  _ 9  o 

-  ~<j s  =os  +c3  is  the  corresponding  innovations  variance. 


o3  is  the  sound  presure  measurement  prediction  by  track  r  while  o3  is  a 
predetermined  artificial  sound  pressure  measurement  error  variance. 

The  likelihoods  (5.14)  and  (5.16)  are  commonly  used  in  many  multitarget 
tracking  algorithms  and  become  extremely  small  if  or  |  sM-s  |  is 

large.  In  such  a  case,  the  likelihood  is  set  to  be  zero  rather  than  a  very  small  but 
still  positive  value.  This  is  done  by  thresholding  as  \<!>M~<t>\  and 

I  sM~s  I  r°>  with  appropriate  thresholding  levels  and  f, .  Such  levels 
may  be  determined  from  the  \2  table. 


Case  2:  Merged  Measurement.  In  order  to  calculate  the  likelihood  func¬ 
tion  in  case  of  #  (T)=2,  i.e.,  when  measurement  merging  occurs,  we  must  make 
some  approximations.  First  we  approximate  q  in  (5.6)  by 

1  if  s  j  >  5s  2 

Jl  otherwise 

s  j+S  2 

where  and  s2  are  sound  pressure  predictions  of  the  two  tracks.  Likewise, 
we  approximate  (5.7)  by 


c  m 
SM 


SM 

SM  +  ~^SM 


if  S  !  >  5s  2 
otherwise 


(5.7’) 


We  denote  the  right  hand  side  of  (5.7’)  as  h3m(sj},SM  ;  s  2).  With  these 
approximations,  we  have 


)  =  9  {<i>M  ~h™  (4>i.^2  »■  9)  5  V ) 


erf(*-4*).erf(z»r**)l 


(5.17) 


+  (1  -  9  )^2 


/(V2tto)  is  the  probability  density  of  a  zero-mean  gaussian 


the  error  function,  and 


-  +  F,T  +  [S"* 


(5.18) 


>  of  the  measurement  noi3e  in  (5.2),  and  er^  being  the  SD  of 
prediction  error  determined  by  r,  for  each  i .  The  other 


qP  ,  -  -  q)P  2  -  -  _ 

h  +  _2-  7 — =y-(««  -  h  t  (Mz ;  *))  .  Mo 


\  /  —2 


P \P  2 

g2Pl  +  (l-g)2P2 


(5.20) 


stic  azimuth  prediction  by  the  local  or  global  GTSD  com- 
d  Pf  =  [oj\2  +  [<7j  ]2,  for  each  1 . 

ressure  part,  we  have 

^2})  =  9  (*m  ~  V(®  iJ 2  !  svs2)  ;'cr3m(svs2 ))  (5.21) 
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~<C(s  i>s  2)  =  v  M5  v*  2)]  +  . 


(5.22) 


the  SD  of  the  sound  pressure  prediction  error  determined  by  the  SPTSD 


component  of  ' track  Ti  for  each  »,  and  <73m(s1,s2)  is  either  v5/2<7j  or  aj, 
depending  on  the  condition  in  (5.7’),  with  0°  being  the  SD  of  the  noise  term  in 
(5.8).  The  derivation  of  (5.17)  and  (5.21)  is  described  in  the  appendix. 


Tracks  Not  Merging  Likelihood.  L  ($  |  {r^})  is  the  likelihood  (proba¬ 
bility)  of  tracks,  and  r2,  not  being  merged,  i.e., 


L  (0  I  {V2»  =  1-Prob.  {{r^rj}} 


(5.23) 


Prob.  {{7„ F,}}  =  erf(  )  -  erf(  #  -  )  (5.24) 

1  J  Vv/Pi  +  ^2  V  y/P\  +  K 


being  the  probability  of  the  two  tracks  being  merged,  where  A  (j)  —  <j>l  -  <j>2. 


Missed  Target  Likelihood.  The  target  detection  model  yields  likelihood 
(probability)  of  a  target  hypothesized  by  the  track  t  being  undetected  in  the 


current  scan,  i.e., 


i  (*  I  {*}) 


=  1_erf(^) 


(5.25) 


Thus  the  evaluation  of  the  newly  expanded  hypotheses  is  equivalent  to  the 
calculation  of  all  the  likelihood  functions  defined  above.  Therefore,  it  is  con¬ 
venient  to  store  all  the  above  likelihoods  in  a  table.  We  call  such  a  table  an 
extended  (because  it  includes  merged  measurements)  track-to-measurement 
cross-reference  table. 


Parallel  to  the  calculation  of  each  likelihood,  we  can  update  each  track 
according  to  the  assumed  measurement  assignment.  When  a  measurement  is 
assigned  to  a  single  track,  both  the  GTSD  and  SPTSD  components  of  the  track 
can  be  updated  by  the  Kalman  filter  or  the  extended  Kalman  filter.  The  latter 
filter  is  used  for  the  global  GTSD  component.  The  necessary  partial  derivative 
calculation  can  be  found  in  [14].  When  a  measurement  is  assigned  to  two  merged 
tracks,  using  the  approximate  joint  measurement  equations,  Equation  (5.5)  with 
q  being  replaced  by  q  (for  the  GTSD  component)  and  Equation  (5.7’)  (for  the 
SPTSD  component),  the  GTSD  and  SPTSD  components  can  be  jointly  updated. 
The  resulting  cross-correlation  between  two  tracks  is  then  ignored  for  simplicity. 
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When  no  measurement  is  assigned  to  a  track,  the  TSD  components  are  not 
updated.  When  a  measurement  is  assigned  to  the  null  track,  i.e.,  a  single  meas¬ 
urement  is  used  to  initiate  a  new  track,  a  single-term  local  GTSD  component  and 
a  SPTSD  component  are  generated  using  the  appropriate  variance  matrices. 

5. 2. 3.3  Hypothesis  Management 

Updated  clusters  are  then  subject  to  hypothesis  management  operations 
including  1)  hypothesis  pruning  in  which  low-probability  hypotheses  are  cut  off, 
2)  hypothesis  combining  in  which  similar  hypotheses  are  combined,  and  3)  cluster 
splitting  in  which  confirmed  or  nearly  confirmed  tracks  are  split  from  a  cluster. 

5.2.4  Information  Fusion 

When  hypotheses  are  received  from  other  nodes,  they  are  fused  with  the 
hypotheses  at  the  node  to  form  new  hypotheses.  As  discussed  in  Section  2,  the 
basic  steps  include  hypothesis  formation,  evaluation  and  management.  The  dis¬ 
tributed  nature  of  the  processing  necessitates  operations  for  checking  that  only 
consistent  hypotheses  are  formed  and  removing  redundant  information  in 
hypothesis  evaluation.  These  operations  are  facilitated  by  means  of  the  informa¬ 
tion  graph  (also  discussed  in  Section  2)  which  is  an  abstract  model  of  the  com¬ 
munication  and  processing  in  the  DSN.  In  the  following  discussion,  we  use  the 
terms  home  and  foreign  to  represent  the  information  present  the  node  and  that 
coming  in  from  an  external  node. 

Although  we  discuss  hypothesis  formation  and  evaluation  separately,  in 
actual  implementation,  they  are  usually  performed  simultaneously  so  that  no 
unnecessary  hypothesis  expansion  is  included.  For  example,  it  is  possible  that  a 
hypothesis  pair  (X1(X2)  satisfies  the  necessary  condition  for  the  fusability  but 
yields  zero  probability. 

5. 2. 4.1  Hypothesis  Formation 

The  key  problem  in  hypothesis  formation  is  in  identifying  the  fus  tbit: 
hypotheses  and  tracks  from  the  home  and  foreign  hypotheses  and  traces. 
According  to  Section  2,  the  entire  fusion  problem  can  be  defined  in  terms  of  the 
information  graph.  Both  the  home  and  foreign  information  states  (tracks  and 
hypotheses,  etc.)  are  defined  at  information  nodes  «j  and  i2.  Then  consistency 
checking  in  hypothesis  formation  starts  by  finding  the  minin.um  set  of  common 


predecessors  of  il  and  z  2  in  the  information  graph.  By  tracing  back  the  graph  to 
this  minimum  set,  fusability  can  be  determined. 


For  two  tracks,  a  home  track  and  a  foreign  track  r2,  are  fused  whenever 
they  are  fusable.  The  two  tracks  are  fusable  if  and  only  if  they  share  the  same 
predecessor  track  on  each  information  node  in  the  common  predecessor  set. 

5. 2. 4. 2  Hypothesis  Evaluation 

Each  fused  hypothesis  is  evaluated  using  equation  (2.28)  of  Section  2.  Let  X 
be  the  fused  hypothesis  and  Z  be  the  cumulative  data  at  the  fusion  information 
node,  then 

P{\\Z)=C~'  n  P(X|,  I  Z,)a(*>  n  1{t)  (5.26) 

ieIR  reX 

where  C  is  the  normalizing  constant,  (IR  ,a)  is  the  information  redundancy  indi¬ 
cator,  X  | ,  is  the  predecessor  of  X  on  the  information  node  i ,  and  l  (t)=L  ( 7vt2 ) 
with  (tvt2)  being  the  pair  of  tracks  uniquely  determined  by  a  fused  track  r. 
{Ir  ,a)  has  been  defined  in  Section  2  (where  it  is  denoted  as  [I  ,a ))  and  represents 
the  redundant  information  at  the  two  information  nodes  i  x  and  z  2.  IR  is  the  set 
of  information  nodes  which  affect  the  common  information  and  a,  a  function 
which  takes  on  value  of  +1  or  -1,  indicates  how  the  redundant  information  can 
be  removed. 

A  key  step  in  hypothesis  evaluation  is  the  computation  of  the  track-to- 
track  likelihood  L  (F1,r2)  for  every  fusable  pair  {tvt2)  of  home  and  foreign  tracks. 
For  each  of  the  tracks  in  the  given  pair,  the  last  time  when  the  track  was 
updated  is  examined.  If  the  updating  times  are  different,  the  TSD  of  the  track 
which  has  not  been  recently  updated  is  extrapolated  so  that  the  two  TSD’s 
correspond  to  the  target  state  at  the  same  time.  Then  the  track-to-track  likeli¬ 
hood  is  calculated  from  the  GTSD  factors  of  the  two  tracks. 

Whenever  the  likelihood  is  positive,  the  fused  track  7=t1Ut'2  is  created. 
Each  fused  track  t  is  then  associated  with  a  fused  TSD  (target  state  distribution) 
which  is  created  by  fusing  the  TSD’s  of  the  tracks  from  which  it  is  fused.  The 
GTSD  component  for  the  fused  track  is  created  from  the  GTSD  components  of 
the  tracks  from  which  it  is  fused.  The  SPTSD  component  of  the  fused  track  is 
the  same  as  that  of  the  home  track  in  the  track  pair  to  be  fused. 


5-26 


A  track  is  called  /oca/  if  it  consists  of  measurements  from  only  one  DSN 
sensor  node;  otherwise  it  is  global.  A  global  track  always  has  a  global  GTSD 
component  (i.e.,  a  geolocational  distribution  in  the  global  cartesian  coordinate). 
A  local  track  usually  only  has  a  local  GTSD  component  (i.e.,  a  geolocational  dis¬ 
tribution  on  the  acoustic  azimuth  and  its  derivative(s)).  The  SPTSD  component 
is  always  local. 

Since  the  home  and  foreign  tracks  may  be  local  or  global  or  even  empty, 
the  computation  of  the  track-to-track  likelihoods  has  to  consider  all  these  possi¬ 
bilities.  The  different  types  of  track-to-track  likelihoods  are  shown  in  Figure  5-7. 
The  calculation  of  the  track-to-track  likelihood  and  the  fused  GTSD  component 
for  each  fused  track  is  described  in  the  following  subsections  for  all  possible  com¬ 
binations  of  home  and  foreign  GTSD  components.  Because  of  symmetry,  some  of 
the  combinations  are  the  same.  Note  also  that  we  have  ignored  the  case  of 
empty  home  track  and  local  foreign  track  since  the  DSN  node  would  not  know 
how  to  use  the  azimuth  information  coming  it.  The  track-to-track  likelihood  is 
thus  set  to  zero.  To  simplify  the  notation,  we  assume  that  each  GTSD  com¬ 
ponent  only  has  a  single  term.  The  results  can  be  generalized  to  the  case  of 
sum-of-gaussians. 

FOREIGN  TRACKS 
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Figure  5-7:  Possible  Track-to-Track  Combinations 


Vvvy 


In  Equations  (5.28)  -  (5.31),  [IR  ,a)  is  the  information  redundancy  indicator.  Let 
I^—IR  \IR,  i.e.,  the  set  of  common  predecessor  nodes  where  the  tracks  have  local 
GTSD  components.  For  each  t  in  IR,  define 

Pi  {tvt2)  =  p,L(<£,<j>)  P  V  ( V  ,*/>)  J  (£  )  (5-33) 

where 

-  (<j>,<l>)  is  the  pair  of  the  estimates  of  the  acoustic  azimuth  and  its  derivative  cal¬ 
culated  from  x  , 

-  ( V  ,\l))  is  the  target  speed/heading  estimated  by  x  , 

-  p,L(v)  is  the  density  of  the  GTSD  component  of  the  predecessor  track  at  i 
(marginal  to  ((j>, <£)), 

-  P  V(v)  1S  density  of  the  a  priori  distribution  of  the  target  speed  and  the 
heading,  and 

-  J  (•)  is  the  appropriate  Jacobian. 

Define 

M  V,)=  (5-34) 

« elk 

Then  the  track-to-track  likelihood  is  calculated  as 

L  {tvT2)  =  M{tVt2)  LL  (T1>T2)  lG  (rl»T2)  (5-35) 

When  the  GTSD  component  of  the  fused  track  is  multiple-termed,  (5.15)  is  calcu¬ 
lated  for  each  term  and  the  weighted  sum  becomes  Ll  {tvt9)  with  the  new 
weights  for  the  fused  track.  The  SPTSD  component  of  the  fused  track  is  identi¬ 
cal  to  that  of  the  home  track. 


5. 2. 4. 2. 3  CASE  3:  bal  Home  Track/Local  Foreign  Track 

When  the  foreign  track  r2  is  local,  every  predecessor  track  (^U^)  | ,  is 
empty  for  every  j  £Ir  except  for  i  j  and  t  2.  If  the  foreign  track  has  a  global 
GTSD,  the  calculation  of  the  likelihood  and  the  fused  GTSD  can  be  done  as  in 
CASE  1. 

Suppose  the  foreign  track  has  a  local  GTSD  component.  Then  the  GTSD 
component  of  the  fused  track  t,\Jt2  has  the  mean  x  and  variance  matrix  E, 
which  are  calculated  by  the  extended  Kalman  filter  equations: 

x  =  Xy  +  #($2-$!)  (5.36) 

where 

-  x  t  is  the  mean  of  the  GTSD  of  the  home  track  tv 

-  $2  is  the  vector  of  the  means  of  the  acoustic  azimuth  and  its  derivative  in  the 
GTSD  component  of  the  foreign  track  r2, 

-  is  the  azimuth  and  its  derivative  of  the  target  at  i  predicted  by  the  x  v 


K  in  (5.36)  is  the  filter  gain  defined  by 

K=ZyHTS~l  (5.37) 

where 


S  =  H  EyH T  +  R  ,  (5.38) 

-'Ey  is  the  variance  matrix  of  the  GTSD  component  of  the  home  track  tv 
-  E  is  the  variance  submatrix  of  the  local  GTSD  component  of  the  foreign  track 


1 


2 


(5.45) 


L  (tvt2)  =  M{tvt2) 


+ 


a  2W  2 


5. 2. 4. 2.6  CASE  6:  Local  Home  Track/Empty  Foreign  Track 

As  in  CASE  4,  L  (r1,0)=M  (r1(0).  The  TSD  of  the  fused  track  is  identical 
to  that  of  the  home  track. 

5. 2. 4.3  Hypothesis  Management 

The  hypothesis  management  procedures  used  in  the  information  fusion  pro¬ 
cess  are  almost  identical  to  those  used  in  the  local  data  process,  and  include 
hypothesis  pruning,  hypothesis  combining  and  clustering. 

5.3  CONCLUSION 


In  this  section,  we  have  presented  acoustic  tracking  scenarios  which  can  be 
used  to  evaluate  the  multiple  hypothesis  approach  to  distributed  tracking  algo¬ 
rithms.  These  scenarios  were  derived  from  the  experimental  set-up  at  the  Lincoln 
Lab.  DSN  test  bed  so  that  the  experiments  can  be  performed  on  the  actual 
testbed  if  resources  permit.  The  general  algorithms  of  Section  2  have  been 
adapted  to  handle  acoustic  sensors.  Because  of  the  characteristics  of  acoustic 
sensors,  such  as  azimuth-only  measurements  and  propagation  delays,  special  tech¬ 
niques  have  been  developed  for  hypothesis  formation  and  evaluation,  especially  at 
the  t-ack  level.  However,  the  overall  architecture  of  Section  2  still  applies. 
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8.  SIMULATION  EXAMPLES 


The  complexity  of  the  algorithms  in  a  DSN  precludes  analytic  approaches 
to  performance  evaluation.  Thus  we  have  developed  a  simulation  environment  as 
a  research  tool  for  developing  algorithms,  evaluating  their  performance,  and 
understanding  the  general  issues  associated  with  a  DSN.  In  this  section,  we  give 
a  brief  description  of  the  simulation  environment  and  present  some  examples 
simulated  in  this  environment. 

8.1  SIMULATION  ENVIRONMENT 

We  first  present  the  hardware  and  software  used  in  the  simulation  environ¬ 
ment.  This  will  be  followed  by  a  description  of  the  user  interfaces  and  capabili¬ 
ties  of  the  software. 


8.1.1  Hardware  and  Software 

The  current  DSN  code  was  first  implemented  on  a  VAX  11-780  under  the 
UNIX  operating  system.  It  was  then  moved  to  the  Symbolics  3600  Lisp  Machine. 
LISP  was  chosen  since  the  data  structures  for  hypotheses  and  tracks  can  be 
represented  conveniently  in  the  form  of  property  lists  or  def-structs  in  LISP. 
Furthermore,  since  the  size  of  the  data  structure  is  dynamic,  being  driven  by  the 
sensor  data  and  communication,  efficient  memory  allocation  and  deallocation  are 
desirable.  Garbage  collection  is  automatic  in  LISP,  thus  simplifying  the  coding 
task. 


The  LISP  machine  also  provides  a  good  environment  for  program  develop¬ 
ment,  including  the  use  of  multiple  windows  and  utilities  to  support  coding  in 
LISP.  It  also  allows  graphical  displays  for  hypotheses,  and  with  the  use  of  a 
second  monitor,  displays  for  the  target  movements. 

In  the  interim  report  [4],  we  presented  an  architecture  for  a  general  test  bed 
environment  within  which  a  DSN  system  may  be  designed  and  prototyped.  This 
architecture,  called  Schemer,  has  since  evolved  into  a  programming  environment 
called  SOPE  (System  Oriented  Programming  Environment).  A  SOPE  system  is 
an  object-oriented  realization  of  a  “system”  as  it  is  thought  of  in  general  system 
theory.  Fundamentally,  a  system  is  an  object  that  performs  a  specialized  set  of 
computations  and  interacts  with  the  rest  of  the  world  sending  and  receiving 
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messages.  The  current  DSN  simulation  was  built  using  some  oi  tne  bUft i  capa¬ 
bilities. 


8.1.2  User  Interface 

An  interface  has  been  provided  for  controlling  the  experiment  as  well  as 
displaying  the  simulation  results  to  the  user.  This  interface  has  also  proved  to  be 
useful  in  program  development. 

Two  kinds  of  displays  have  been  developed  for  the  DSN  simulation:  a  situa¬ 
tion  display  for  the  scenario  and  a  hypothesis  display.  The  situation  display  is  on 
a  color  monitor  and  the  hypothesis  display  is  on  a  black  and  white  monitor. 
Various  display  functions  are  controlled  by  means  of  menus  and  the  mouse.  The 
two  displays  are  shown  in  Figure  6-1  and  6-2. 

The  hypothesis  display  (Figure  6-1)  on  the  current  system  shows  all  the 
hypotheses  for  all  the  nodes  (four  at  present).  For  each  node,  the  evolution  of 
the  hypotheses  are  shown.  Each  circle  denotes  a  hypothesis  and  the  number  in 
each  hypothesis  is  the  probability  of  the  hypothesis.  The  parent  and  children  of 
each  hypothesis  within  the  node  are  connected  by  lines.  By  pointing  the  mouse 
to  a  hypothesis  which  results  from  fusion,  one  can  also  identify  its  predecessors 
from  other  DSN  nodes.  In  the  figure,  the  predecessors  for  a  fused  hypothesis  are 
darkened. 

The  situation  display  (Figure  6-2)  on  the  current  system  shows  the  scenario 
under  consideration,  and  the  sensor  characteristics.  For  each  time,  the  target 
locations  and  the  measurements  can  be  displayed.  By  pointing  the  mouse  to  each 
hypothesis,  one  can  also  display  the  target  locations  according  to  the  hypothesis. 
Thus,  the  evolution  of  the  situation  becomes  obvious  as  one  moves  the  mouse 
within  each  node.  Furthermore,  by  considering  the  hypotheses  from  multiple 
DSN  nodes,  one  can  identify  how  information  is  being  fused. 

8.1.3  System  Capabilities 

The  current  simulation  focuses  on  the  processing  within  each  node  and  a 
perfect  (noiseless)  communication  model  is  assumed.  Each  node  in  the  network  is 
equipped  with  a  GTC  (Generalized  Tracker/Classifier)  which  processes  the  local 
sensor  data  and  an  information  fusion  module  which  fuses  the  information  sent 
from  the  other  nodes  with  the  local  information.  The  current  simulation  has  the 
following  capabilities: 
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•  The  maximum  number  of  nodes  which  can  be  handled  in  the  network  is  four. 
There  is  no  conceptual  difficulty  in  ir  creasing  the  limit  on  the  number  of  nodes 
but  simulation  time  will  increase  substantially  since  a  single  computer  is  used 
to  simulate  a  distributed  system. 

•  The  communication  between  any  two  nodes  can  be  specified  arbitrarily.  By 
using  the  information  distribution  module,  adaptive  time-varying  communica¬ 
tion  strategies  can  be  handled. 

•  The  processing  of  the  local  sensor  data  is  by  means  of  the  GTC  developed  in 
the  previous  project  [1].  Information  fusion  is  based  on  algorithms  for 
hypothesis  formation  and  evaluation  described  in  Section  2. 


For  scenarios  with  average  target  density,  false  alarm  rate,  detection  proba¬ 
bility,  and  measurement  accuracy,  the  algorithm  runs  reasonably  fast.  However, 
the  fact  that  a  single  machine  is  used  for  data  generation,  communication  simula¬ 
tion,  and  simulation  of  multiple  nodes  makes  it  difficult  to  evaluate  the  actual 
performance  in  terms  of  speed.  Furthermore,  the  garbage  collection  of  the  LISP 
machines  sometimes  interferes  with  the  processing. 

In  order  to  handle  arbitrary  communication  patterns  among  the  nodes,  the 
information  fusion  algorithm  includes  mechanisms  to  trace  the  histories  of  the 
tracks  and  hypotheses  in  the  information  graph.  Without  any  loss  of  generality, 
information  fusion  from  multiple  nodes  is  carried  out  sequentially  in  a  binary 
form,  i.e,  to  fuse  the  information  from  node  A,  B  and  C,  we  first  fuse  that  of  A 
and  B,  and  then  the  result  is  fused  with  the  information  from  C.  This  simplifies 
the  implementation  of  the  fusion  algorithm  considerably. 

0.2  DISCRETE  ROAD  NETWORK  EXAMPLE 

We  now  present  some  simulation  results  for  a  four-node  sensor  network  to 
illustrate  the  performance  of  the  DSN  fusion  algorithm.  We  use  a  simple 
discrete-state  road  network  scenario  where  the  target  dynamics  are  assumed  to  be 
Markov  with  the  road-segments  as  the  possible  states.  The  main  reason  for  using 
the  simple  target  dynamics  and  scenario  was  to  minimize  any  unnecessary 
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numerical  complexity  due  to  target  motion  and  to  concentrate  more  on  issues 
resulting  from  arbitrary  communication  pattern.  The  simulation  program,  how¬ 
ever,  is  capable  of  handling  more  complicated  scenarios  if  the  appropriate  algo¬ 
rithms  are  included. 

8.2.1  Target  and  Sensor  Models 

The  underlying  models  in  the  scenario  are: 


a.  Targets  move  along  the  road  network  with  discretized  straight-line  segments. 

b.  The  target  dynamics  are  Markov  with  a  given  transition  matrix. 

c.  Each  sensor  measures  position  (segment  number)  along  the  road  with  some 
uncertainty  due  to  the  bearing  and  range  measurement  noise.  Each  sensor 
also  has  certain  masked  regions  which  it  cannot  observe. 

d.  The  probability  of  detection  of  a  target  in  each  road-segment  by  a  sensor  is  a 
function  of  sensor  masking  and  the  relative  sensor  location. 


In  addition  to  this,  independent  and  identically  distributed  target  models  have 
also  been  assumed  in  the  current  simulation. 

There  are  four  nodes  in  the  DSN,  with  a  sensor  at  each  node.  The  sensors 
observe  the  same  road  network  although  they  have  different  fields-of-view.  The 
road  network  and  the  location  of  the  sensors  are  shown  in  F igure  6-3.  Each  indi¬ 
vidual  target  position  is  represented  by  the  er-ment  number  and  its  evolution  is 
assumed  to  be  a  Markov  process.  The  t?  e  at  any  time  is  thus  character¬ 
ized  by  a  probability  distribution  on  the  egment.  Because  of  the  terrain 

and  other  masking  (due  to  foliage,  etc)  the  sensors  have  masked  regions.  When 
the  target  moves  into  these  regions,  it  will  not  be  seen  by  the  sensor.  A  sensor 
can  fail  to  detect  a  target  in  the  unmasked  region  because  the  probability  of 
detection  is  less  than  one.  Figures  6-4  to  6-7  show  the  detection  probabilities  of 
the  four  sensors.  Each  sensor  generates  a  measurement  in  the  following  way. 
The  detection  of  a  target  at  state  i,  by  a  sensor  depends  on  the  detection  proba¬ 
bility  which  is  0  whenever  the  target  is  in  a  masked  region  relative  to  the  sensor. 
For  any  detected  target  located  at  x ,  the  measurement  y ,  which  is  also  a 


Figure  6-6:  Probability  of  Detection  of  Sensor  3 


Figure  6-7:  Probability  of  Detection  of  Sensor  4 


segment  number,  is  generated  according  to  the  following  conditional  probability 
distribution  function:  (see  Figure  6-8) 


P  {y  I  x)  »  Sa, ■  (y,  )U{yt  )  (6.1) 

t 


where 

r  mui(y»  ) 

a,-(y,-)=  /  /  0r(r  I  F(x))g^|d(x))drd0  (6.2) 

r  min(  J/t  )  ^min(  S^i  ) 


U  ( y , )  is  a  uniform  function  on  segment  yi  with  unity  value  and  gT  (r  |  r  (x  )) 
and  I  0(x))  are  sensor  characteristics  corresponding  to  the  the  measurement 
uncertainty  in  range  and  bearing  given  the  average  range  and  bearing  of  a  partic¬ 
ular  target  location  x .  False  alarms  are  also  added  according  to  the  sensor 
model. 


The  total  number  of  targets  is  constant  but  unknown  and  its  a  priori  distri¬ 
bution  is  Poisson  with  mean  u0.  The  number  of  false  alarms  in  each  scan  is  also 
Poisson  with  mean  uFA  for  each  sensor.  The  target  positions  are  independent 
and  identically  distributed  with  the  a  priori  distribution  uniform  over  the  road 
network  states,  and  targets  are  expected  to  move  into  the  field-of-view  from  the 
edges  at  any  time.  The  parameters  used  in  the  simulations  are  given  in  Table  6- 
1. 


Figure  6-8:  Conditional  Probability  Distribution  p(y\x) 


Table  6-1:  Simulation  Parameters 


Expected  number  of  targets 

uo 
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Expected  number  of  false  alarm 

UFA 
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Probability  of  detection 
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6.2.2  Communication  Schemes 

Different  kinds  of  communication  patterns  were  experimented.  The  first 
(decentralized  case)  consists  of  no  communication  among  the  nodes.  The  second 
is  hierarchical  communication  with  the  following  features: 


1.  At  every  odd  scan  NODE  1  sends  information  to  NODE  2,  and  NODE  3  sends 
information  to  NODE  4. 

2.  At  every  even  scan  NODE  4  sends  information  to  NODE  2. 


i.e,  node  1  and  node  3  only  transmit  information  to  other  nodes,  node  4  is  an 
intermediate  receiver/processor/transmitter  and  all  information  is  thus  collected 
by  node  2  with  communication  delays.  The  hierarchical  communication  pattern 
and  the  information  graph  are  shown  in  Figure  6-9  and  Figure  6-10.  The  third 
case  considered  is  broadcast  communication. 
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6.2.3  Simulation  Results 


In  each  simulation,  all  the  hypotheses  were  examined  and  compared  to  the 
true  trajectories  of  targets  according  to  the  measurement-to-target  association 
histories.  The  hypothesis  best  matched  to  the  ground  truth  is  defined  as  a  true 
hypothesis.  The  most  likely  hypothesis  (highest  probability)  is  called  the  best 
hypothesis. 

The  results  of  a  simulation  run  are  shown  in  Figures  6-11  to  6-12  where  the 
probabilities  of  the  true  and  best  (with  highest  probability)  hypotheses  are  plot¬ 
ted  versus  time  for  each  of  the  four  DSN  nodes.  Note  how  the  probabilities  of 
the  hypotheses  change  with  time.  In  general  the  true  hypothesis  and  best 
hypothesis  are  not  the  same  when  the  data  quality  is  poor.  This  argues  for  the 
multiple-hypothesis  approach  since  if  only  the  best  hypothesis  is  selected,  an 
incorrect  hypothesis  may  result.  The  probabilities  of  the  best  hypotheses  and 
true  hypotheses  for  each  node  for  the  no  communication  case  are  shown  in  Figure 
6-11.  Note  that  because  of  their  data  quality,  the  best  hypotheses  for  NODES  1, 
2  and  4  are  not  the  correct  hypotheses.  NODE  3,  however,  tracks  the  targets 
correctly.  In  the  hierarchical  case  (Figure  6-12),  the  hypotheses  of  NODE  1  and 
NODE  3  behave  the  same  as  in  the  case  with  no  communication  since  they  do 
not  -eceive  any  information  from  other  nodes  NODE  4  now  has  the  help  of 
NODE  3  and  performs  much  better,  acquiring  the  correct  hypothesis  after  a 
while.  NODE  2  performs  best  since  eventually  it  gets  information  from  all  nodes. 
In  the  broadcast  case,  the  nodes  all  find  the  true  hypothesis  in  a  short  time. 

Figures  6-13  and-  6-14  show  the  hypothesis  trees  for  the  two  cases  discussed 
above.  The  number  of  hypotheses  for  each  node  varies  with  time,  depending  on 
the  complexity  of  the  current  situation.  For  example,  in  Figure  6-13,  NODE  3 
starts  out  with  four  hypotheses  around  scan  (tick)  3,  with  the  true  hypothesis 
having  a  fairly  low  probability.  As  it  collects  more  data,  the  situation  clears  up 
so  that  there  are  only  two  hypotheses  at  scan  8.  This  phenomenon  is  even  more 
pronounced  in  Figure  6-14  where  NODE  4  starts  with  four  hypotheses  with 
nonzero  probability  at  scan  2  and  3.  With  communication  from  NODE  3,  only 
one  hypothesis  has  nonzero  probability  at  scan  8. 


6.3  CONTINUOUS  STATE  EXAMPLE 

Figures  6-15  and  6-16  present  some  results  in  continuous  state  tracking. 
The  network  consists  of  two  nodes  (denoted  by  1  and  2)  which  broadcast  their 
hypotheses  periodically.  The  azimuth  measurement  of  each  sensor  is  more 
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Figure  6-11:  Performance  of  Nodes  with  No  Communication 
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accurate  than  the  range.  Initially  for  scan  1  and  scan  2,  each  sensor  has  only  one 
hypothesis  consisting  of  two  tracks.  The  tracks  of  Sensor  1  are  denoted  by  solid 
lines  with  ellipses  being  the  error  covariances  while  the  tracks  of  Sensor  2  are 
denoted  by  dotted  lines.  At  time  3,  the  sensors  broadcast  to  each  other  and 
information  fusion  takes  place  at  each  node.  Because  of  the  overlapping  error 
ellipses,  multiple  hypotheses  are  formed.  Figure  6-15  shows  one  hypothesis  with 
two  tracks  and  Figure  6-16  shows  the  other  hypothesis.  The  pairs  of  tracks 
which  are  associated  by  the  hypothesis  can  be  traced  from  the  centers  of  the 
fused  tracks  at  time  3.  From  the  two  fusion  hypotheses  at  time  3,  each  node 
processes  additional  measurements  at  scans  4  and  5.  The  two  branches  of  the 
hypothesis  tree  are  shown  in  the  two  figures.  At  time  6,  the  two  nodes  communi¬ 
cate  again.  Since  in  Figure  6-15,  the  ellipses  of  the  same  target  according  to  the 
two  nodes  have  little  overlap,  the  probability  of  this  hypothesis  goes  to  zero.  On 
the  other  hand,  the  hypothesis  in  Figure  6-16  is  still  valid  and  the  track  state 
estimates  from  the  two  nodes  are  fused  to  obtain  an  improved  estimate. 

6.4  CONCLUSION 

We  have  found  the  simulation  environment  to  be  very  useful  in  developing 
and  evaluating  algorithms  and  in  studying  the  various  issues  associated  with  a 
DSN.  The  information  fusion  algorithms  developed  in  Section  2  have  been  tested 
via  simulations  using  various  examples.  The  results  demonstrate  that  the  perfor¬ 
mance  of  the  DSN  nodes  can  be  improved  through  communication.  We  have  also 
shown  that  the  multiple  hypothesis  approach  developed  in  this  research  works 
better  than  the  traditional  (single  hypothesis)  approach  when  the  scenario  is  com¬ 
plicated.  Various  communication  schemes  with  different  number  of  nodes  have 
been  examined.  The  simulation  results  have  shown  that  the  algorithms  produce 
the  expected  performance. 


7.  CONCLUSIONS 


The  goals  of  our  research  were  to  further  understand  the  issues  associated 
with  a  distributed  sensor  network  and  to  develop  a  general  theory  of  distributed 
multitarget  tracking  to  provide  some  guidance  in  building  a  DSN.  This  theory 
should  be  general  enough  to  encompass  arbitrary  network  structures,  target  and 
sensors  models.  For  the  theory  to  be  relevant,  it  should  also  lead  to  implement- 
able  algorithms. 

In  our  previous  effort,  we  developed  a  general  theory  for  tracking  multiple 
targets.  In  the  current  effort,  this  theory  was  extended  to  the  distributed  situa¬ 
tion.  Information  fusion  algorithms  were  developed  for  fusing  or  integrating  the 
information  from  other  nodes  with  the  local  information.  For  general  communi¬ 
cation  patterns,  these  information  fusion  algorithms  insure  that  only  consistent 
hypotheses  are  formed  and  that  no  information  is  double  counted  (which  would 
lead  to  inconsistent  conclusions).  To  the  best  of  our  knowledge  the  algorithms 
we  have  developed  are  the  first  to  address  these  issues.  The  algorithms  make 
heavy  use  of  the  so  called  information  graph  which  can  be  viewed  as  an  abstract 
model  of  the  DSN  communication  structure.  They  also  become  the  more  stan¬ 
dard  algorithms  with  the  appropriate  assumptions. 

In  many  military  applications,  targets  frequently  have  special  structures. 
For  example,  the  state  of  a  target  may  have  different  attributes  such  as  location 
and  velocity,  a  consistent  set  of  features,  etc.  The  sensors  at  the  various  DSN 
nodes  may  not  be  the  same.  One  node  may  observe  a  certain  set  of  features 
while  another  node  may  observe  a  different  set  of  features  so  that  the  nodes  need 
to  cooperate  to  obtain  a  more  global  view  and  perhaps  classify  the  target.  By 
using  the  general  results  for  distributed  tracking,  we  have  obtained  algorithms  for 
dissimilar  sensors  and  targets  with  structured  states.  This  is  a  case  where  our 
general  theory  applies  quite  readily. 

Targets  may  also  move  in  groups.  This  is  another  case  where  there  is  some 
structure  on  the  targets.  The  knowledge  about  the  group  can  be  used  in  tracking 
since  the  individual  targets  no  longer  move  independently.  The  key  research 
issue  is  how  to  exploit  this  knowledge  and  avoid  the  combinatorics  associated 
with  tracking  the  members  of  \he  group.  We  have  developed  a  mathematical 
framework  for  treating  groups  of  targets.  The  results  obtained  to  date  are 
mostly  for  the  centralized  situation.  Development  of  the  distributed  algorithms 


can  follow  the  same  approach  used  for  independent  targets. 


To  further  evaluate  the  generality  of  our  approach  and  also  relate  to  the 
work  undertaken  by  Lincoln  Lab.  on  acoustic  tracking,  we  applied  our  algorithms 
to  acoustic  sensors  tracking  low-flying  targets.  Because  of  the  special  characteris¬ 
tics  of  acoustic  seniors  (azimuth  only  measurements,  propagation  delays,  etc.) 
some  modifications  had  to  be  made  to  the  track-level  algorithms  and  likelihood 
computations.  However,  the  general  overall  framework  is  still  applicable.  We 
also  looked  into  the  design  of  experiments  using  scenarios  similar  to  those  used 
by  Lincoln  Lab. 

We  have  developed  an  environment  for  developing  and  demonstrating  the 
algorithms.  Scenarios  for  which  we  developed  algorithms  for  include  tracking 
land  vehicles  over  a  road  network  using  MTI  (moving  target  indicator)  sensors 
and  tracking  air  targets  with  sensors  which  are  more  accurate  in  azimuth  meas¬ 
urements  than  range.  Although  not  included  in  this  report,  the  same  algorithms 
were  also  used  to  track  submarines. 

In  summary,  we  believe  we  have  developed  a  theory  which  is  applicable  to 
general  DSN  problems.  The  theory  has  a  sound  theoretic  basis  and  has  also  been 
demonstrated  through  simulation  studies  for  different  scenarios. 
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APPENDIX  A.  MERGED  MEASUREMENT  LIKELIHOOD 

CALCULATION 

The  likelihood  of  a  measurement  y  originating  from  two  existing  tracks,  tx 
and  r2,  is  the  joint  mixture  of  probability  density  of  y  with  the  probability  of 
event  M  of  track  merging  and  that  of  event  D  of  target  detection,  and  is 
expanded  as 

P  (y  ,M  ,D  I  7„72)  =  J  P{y  \M,D,X  vx  2,7„72)  P  (M  |  D  ,x  vx  2,Tvt2){  Al) 


P{D  |  xvx2,tvt2)  P{xx  |  Tl)  P{x2  |  T2)dxxdx2 

When  we  identify  D  with  the  event  in  which  s^  =  s  1+^3  >sth  *or  1  an<^  2, 
we  have 

(  STH  ~s  1  \1 

P(D  |  xvx2,tvt2)  =  P{D  |  svs2)=  1  -  erf^ — - - Jj 

U  3 

(A2) 

L  v  a, 


The  track  merging  event  is  written  as  M  =  {  |  <t>M  -  <I>m  |  <&£}>  an(i  hence  we 
have 


P{M  |  D  ,xvx  2,tvt2)  = 


^  6<t>  -  ( <t>i  ~  <t>2)  ^  -  (<ft i  ~  <ftz) 

VW)2+K2)2  VW)2+K2)2 


where  oj  the  standard  deviation  determined  by  Equation  (5.4)  for  each  i .  The 
first  factor  in  the  integrand  in  (Al)  is  then  written  as 


P  (y  |  M,D  ,xvx  2 ,tvt2)  =  P{4fi\M  ,<M 2)  P  {sff  \  D  ,s  vs  2)  (A4) 


where  <f>$  and  stf  are  defined  by  Equations  (5.5)  -  (5.7).  In  the  first  factor  of  the 
right  hand  side  of  (A4),  the  condition  D  was  dropped  because  <t>fi  can  be  defined 
as  being  independent  from  the  detection  event  D  .  Similarly,  in  the  second  fac¬ 
tor,  the  condition  M  has  been  dropped  because  s$  can  be  considered  to  be 
defined  by  (5.7)  regardless  of  whether  or  not  the  actual  merging  occurs.  When 
we  approximate  (5.7)  by  (5.7’),  we  have 


P(5^  |  £>  ,«lta2,?)  = 


s  2;s  1(s  2 


)  j  ^4  (s  i>s  2)) 


-  hsm(s  vs  2;s  vs  2) 

°r{*  i.®2) 


) 
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The  denominator  of  the  right  hand  side  of  (A5)  is  necessary  because  the  range  for 
stf  is  Sffj  ,00).  Furthermore,  we  may  approximately  equate  the  right  hand  side 
of  (A2)  with  the  denominator  of  the  right  hand  side  of  (A5).  Then,  since  the 
GTSD  component  and  the  SPTSD  component  of  a  track  are  independent  from 
each  other,  we  have 


P(y,M,D  |r„rj=  f  P(tff  I  M 


)  -  erf( 
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The  last  integral  in  (A6)  can  be  easily  calculated  and  yield  to  (5.21).  On  the 
other  hand,  since  and  the  track  merging  event  M  are  correlated,  the  calcula¬ 
tion  of  the  first  integral  in  the  last  expression  of  (A6)  is  not  so  straightforward. 
But,  according  to  [16],  we  have 
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which  yields  (5.17). 

I 


A-2 


